[tor-bugs] #19183 [Metrics/Metrics website]: Add sybilhunter's visualisations to Metrics website

Tor Bug Tracker & Wiki blackhole at torproject.org
Wed Jun 29 17:17:15 UTC 2016


#19183: Add sybilhunter's visualisations to Metrics website
-------------------------------------------------+-------------------------
 Reporter:  phw                                  |          Owner:  phw
     Type:  enhancement                          |         Status:  new
 Priority:  Medium                               |      Milestone:
Component:  Metrics/Metrics website              |        Version:
 Severity:  Normal                               |     Resolution:
 Keywords:  sybilhunter, visualization, churn,   |  Actual Points:
  uptime                                         |         Points:
Parent ID:                                       |        Sponsor:
 Reviewer:                                       |
-------------------------------------------------+-------------------------

Comment (by phw):

 Replying to [comment:4 karsten]:
 > However, I noticed that you didn't implement the wide-to-long suggestion
 I mentioned a few months ago on [https://lists.torproject.org/pipermail
 /metrics-team/2016-February/000076.html metrics-team@], and I think that
 would make the graphing code somewhat easier.  How likely is it that
 you'll find the time to work on that issue?

 I just added that feature.  It's in the following branch:

 {{{
 git clone -b long-format
 https://git.torproject.org/user/phw/sybilhunter.git
 }}}

 The default output is now the long format.  Here's an example:

 {{{
 Date,Authority,BadExit,Exit,Fast,Guard,HSDir,Named,Running,Stable,Unnamed,V2Dir,Valid,NewChurn,GoneChurn
 2016-05-31T01:00:00Z,T,NA,NA,NA,NA,NA,NA,NA,NA,NA,NA,NA,0.00000,0.00000
 2016-05-31T01:00:00Z,NA,T,NA,NA,NA,NA,NA,NA,NA,NA,NA,NA,0.00000,0.00000
 2016-05-31T01:00:00Z,NA,NA,T,NA,NA,NA,NA,NA,NA,NA,NA,NA,0.00457,0.00457
 2016-05-31T01:00:00Z,NA,NA,NA,T,NA,NA,NA,NA,NA,NA,NA,NA,0.00480,0.00315
 2016-05-31T01:00:00Z,NA,NA,NA,NA,T,NA,NA,NA,NA,NA,NA,NA,0.00552,0.00184
 2016-05-31T01:00:00Z,NA,NA,NA,NA,NA,T,NA,NA,NA,NA,NA,NA,0.00300,0.00030
 2016-05-31T01:00:00Z,NA,NA,NA,NA,NA,NA,T,NA,NA,NA,NA,NA,NaN,NaN
 2016-05-31T01:00:00Z,NA,NA,NA,NA,NA,NA,NA,T,NA,NA,NA,NA,0.00643,0.00514
 2016-05-31T01:00:00Z,NA,NA,NA,NA,NA,NA,NA,NA,T,NA,NA,NA,0.00118,0.00067
 2016-05-31T01:00:00Z,NA,NA,NA,NA,NA,NA,NA,NA,NA,T,NA,NA,NaN,NaN
 2016-05-31T01:00:00Z,NA,NA,NA,NA,NA,NA,NA,NA,NA,NA,T,NA,0.00349,0.00501
 2016-05-31T01:00:00Z,NA,NA,NA,NA,NA,NA,NA,NA,NA,NA,NA,T,0.00643,0.00514
 }}}

 Is that something you can work with?

 >  - We start by adding two new "link" pages to your
 [https://nymity.ch/sybilhunting/churn-values/slide_2016-01.html churn] and
 [https://nymity.ch/sybilhunting/uptime-visualisation/slide_2014-01.html
 uptime] visualizations.  Can you send me text similar to the
 [https://gitweb.torproject.org/metrics-
 web.git/tree/website/etc/metrics.json#n532 "oxford-anonymous-internet"
 link page] but for these two new link pages?  We'll need this text anyway
 even when we take the next steps below.

 Here's what I would add to website/etc/metrics.json:

 {{{
   {
     "id": "uptimes",
     "title": "Monthly uptime of Tor relays",
     "tags": [
       "Relays"
     ],
     "type": "Graph",
     "level": "Advanced",
     "description": "<p>The following image illustrates the uptime of Tor
 relays for the past month.  Each row of pixels denotes one consensus (that
 is, one hour), and each column denotes one relay.  Black pixels mean that
 a relay was online, and white means offline.  So, each pixel denotes if a
 given relay was online or offline at a given hour.  We use red pixels to
 highlight relays with identical uptime patterns.</p>",
     "function": "plot_uptimes",
     "parameters": [
       "start",
       "end"
     ],
     "data": [
       "servers-data"
     ],
     "related": [
       "networkchurn"
     ]
   },
   {
     "id": "networkchurn",
     "title": "Network churn rate by relay flag",
     "tags": [
       "Relays"
     ],
     "type": "Graph",
     "level": "Advanced",
     "description": "<p>The following graph shows the churn rate of the Tor
 network by <a href=\"about.html#relay\">relay</a> flag. The churn rate, a
 value in the interval [0,1] captures the rate of relays joining and
 leaving the network.</p>",
     "function": "plot_networkchurn",
     "parameters": [
       "start",
       "end"
     ],
     "data": [
       "servers-data"
     ],
     "related": [
       "uptimes",
       "networksize",
       "relayflags"
     ]
   },
 }}}


 >  - We add a new page type to Metrics called "gallery" which displays
 image files from a local directory directly on the Tor Metrics site.  We
 need this type anyway for the uptime visualizations even when we replace
 the churn visualizations by something more interactive below.  We'd
 produce these images exactly how you're currently producing them on your
 server but on the metrics server.  Once we deploy this gallery pages,
 we'll replace the corresponding link pages, though we'd keep the URLs
 unchanged.
 >
 >  - We write some R/ggplot2 code to make the churn visualizations
 somewhat more interactive by letting users select start and end date, flag
 type, and displayed metric (absolute numbers, fractions, etc.).

 Sounds good to me.  Please let me know if there's anything I can do to
 help.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/19183#comment:5>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online


More information about the tor-bugs mailing list