[tor-bugs] #4407 [Metrics Website]: Create a basic monitoring infrastructure for large scale events

[Tor Bug Tracker & Wiki]

#4407: Create a basic monitoring infrastructure for large scale events
-----------------------------+----------------------------------------------
 Reporter:  atagar           |          Owner:  karsten
     Type:  task             |         Status:  new    
 Priority:  normal           |      Milestone:         
Component:  Metrics Website  |        Version:         
 Keywords:                   |         Parent:         
   Points:                   |   Actualpoints:         
-----------------------------+----------------------------------------------

Comment(by atagar):

 > My suggestion is to continue using a Java application that gets executed
 once per hour by cron.

 The first question that comes to mind is: do we need monitors to have
 historical data? This was the reason I avoided the metrics codebase for my
 consensus tracker script. Once you add its java and DB prereqs the
 installation and complexity of the system gets much worse with, I think,
 little benefit.

 What I'd like to see is for the alarm infrastructure to use a metrics
 service API, but itself be a separate and distinct component.

 That said, this decision is really up to whoever codes it. If it's
 something like the above then I'd be happy to mentor, and if it's an
 expansion of the metrics codebase then guess that ball's in your court. If
 no one gets to it first then I might hack on it later as a client for
 stem.

 > But I already know 1 person who won't like that suggestion. ;)

 Bold accusation! Actually, if you'd proposed a java project when I first
 joined the community I would have been all over it - I have far more java
 development experience than python.

 > We can implement trivial things like "we just lost more than 25% of the
 relays in one hour." But what we really need is someone to sit down with
 the descriptor archives and look what are expected changes and what
 changes would be unusual.

 Right. What I'd like to see first is alarms for when the sky is falling.
 After that it becomes a question of tuning and pattern matching which
 could then easily lead to interesting research projects - hint hint,
 researchy people. :)

 Cheers! -Damian

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/4407#comment:2>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online