[tor-bugs] #2543 [Metrics]: Create graphs of #1919 torperfs

[Tor Bug Tracker & Wiki]

#2543: Create graphs of #1919 torperfs
----------------------------+-----------------------------------------------
    Reporter:  mikeperry    |       Owner:  karsten
        Type:  enhancement  |      Status:  closed 
    Priority:  normal       |   Milestone:         
   Component:  Metrics      |     Version:         
  Resolution:  implemented  |    Keywords:         
      Parent:               |      Points:         
Actualpoints:               |  
----------------------------+-----------------------------------------------

Comment(by mikeperry):

 Replying to [comment:8 karsten]:
 > Replying to [comment:7 mikeperry]:
 > Also, it's more complicated than it probably seems to add these new
 graphs without breaking the existing graphs.
 >
 > My plan is to do the analysis offline and not touch the website code at
 all.  If we find out that we like certain graphs and if we decide we want
 to track these graphs over time, then we should add new graphs to the
 website.  But I'm not even convinced that we'll keep the Torperfs with
 custom guard node selections running in the future.  It might be that
 we'll learn something from the experiment and decide we want to do a new
 experiment.  In that case we'll be angry about wasting programming effort
 to get new graphs on the website.

 Ok. How about generating these quartile over time graphs offline. Does
 code to do so exist anywhere? I would love to see these 15 graphs over
 time as we perform a few experiments.

 > > I also think we should capture the 1st and 4th quartiles in a
 different color, so we can keep an eye on the total spread over time
 (since variance is the pain point of tor use).
 >
 > I don't understand.  The 1st quartile is the area below the dark line
 and the 3rd quartile is the area above it.  What do you mean?

 Technically you are correct, but the 1st quartile in particular also has a
 lower bound, which is the fastest request to complete for that timeslice.
 The 4th quartile has an upper bound, which is the slowest request to
 complete.

 But what I really want to visualize over time is the variance in that top
 quartile, which I suppose is also a function of its density.. I want to
 run a few CBT experiments and a handful of bandwidth authority experiments
 while we are gathering these metrics, and I want to observe if they
 improve or worsen our variance in that top, 4th quartile. This may mean we
 need multiple quantiles, or maybe just stick to density plots like we have
 in timematrix.png.

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/2543#comment:9>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online