[tor-bugs] #28547 [Core Tor/sbws]: Monitor relays that are not measured by each sbws instance

[Tor Bug Tracker & Wiki]

#28547: Monitor relays that are not measured by each sbws instance
---------------------------+-------------------------------------
 Reporter:  teor           |          Owner:  (none)
     Type:  defect         |         Status:  new
 Priority:  Medium         |      Milestone:  sbws 1.0 (MVP must)
Component:  Core Tor/sbws  |        Version:
 Severity:  Normal         |     Resolution:
 Keywords:  tor-bwauth     |  Actual Points:
Parent ID:  #25925         |         Points:
 Reviewer:                 |        Sponsor:
---------------------------+-------------------------------------

Comment (by teor):

 Replying to [comment:2 juga]:
 > I'm using the same pad you created for #28563 to think also on the
 KeyValues we would need and where they could be obtained from, which is
 related to the children tickets.

 I want to do an initial release with a few extra keys. When we look at the
 results, we can decide which failures we need to focus on.

 Here are the questions I want to answer in the initial release:
 1. Is sbws getting enough consensuses? Is this relay missing from
 consensuses?
 2. Is sbws putting enough relays in priority lists? Is this relay in
 enough priority lists?
 3. Is sbws measuring enough relays? Is this relay getting measured enough?
 4. Is sbws including enough results? Does this relay have enough included
 results?

 Here are my draft key rules:
 A. Each new key should add new information, that can't be calculated from
 other keys
 B. Keys that contain repeated information should be in the header.
 C. The good case and the bad case should be easy for humans to see.
 D. Add a small number of keys to identify problems. Then add more keys to
 diagnose the problems.

 I also have another rule just for this ticket:

 We should ignore everything that is older than 5 days. Because anything
 older than 5 days can't affect the result. It will be easier to see recent
 issues if we exclude old data.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/28547#comment:3>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online