[tor-bugs] #13425 [Onionoo]: Add new document type `debug` that includes digests of recently published descriptors and statuses they're referenced from

[Tor Bug Tracker & Wiki]

#13425: Add new document type `debug` that includes digests of recently published
descriptors and statuses they're referenced from
-------------------------+---------------------
 Reporter:  karsten      |          Owner:
     Type:  enhancement  |         Status:  new
 Priority:  normal       |      Milestone:
Component:  Onionoo      |        Version:
 Keywords:               |  Actual Points:
Parent ID:               |         Points:
-------------------------+---------------------
 This suggestion is based on discussions with Sebastian related to #13135.

 We should add a new document type, let's call it `debug`, that includes
 digests of recently published descriptors together with the valid-
 after/published times of statuses referencing them.  This includes all
 kinds of descriptors published by relays/bridges, so server descriptors
 and extra-info descriptors, and descriptors derived from those by the
 directory authorities, namely microdescriptors.  We should only include
 recently published/referenced descriptors here, which could mean in the
 past 24 hours.

 The reason for creating a new document type is that most Onionoo clients
 won't care, and we shouldn't make them download something they're not
 interested in.  There's other stuff that would go into the new document
 type, like vote details that can be used to debug problems with the voting
 process.

 Example request and response (not working yet):

 https://onionoo.torproject.org/debug?search=F2044413DAC2E02E3D6BCF4735A19BCA1DE97281

 {{{
 {
     "version": "1.1",
     "next_major_version_scheduled": "2014-11-15",
     "relays_published": "2014-10-15 15:00:00",
     "relays": [
         {
             "fingerprint": "F2044413DAC2E02E3D6BCF4735A19BCA1DE97281",
             "server_descriptors": {
                 "351CB6585CF9BA311204B4E93A509183B85EBFD7": [
                     "2014-10-14 16:00:00",
                     "2014-10-14 17:00:00",
                     "2014-10-14 18:00:00",
                     "2014-10-14 19:00:00",
                     "2014-10-14 20:00:00",
                     "2014-10-14 21:00:00",
                     "2014-10-14 22:00:00",
                     "2014-10-14 23:00:00",
                     "2014-10-15 00:00:00",
                     "2014-10-15 01:00:00",
                     "2014-10-15 02:00:00",
                     "2014-10-15 03:00:00",
                     "2014-10-15 04:00:00",
                     "2014-10-15 05:00:00",
                     "2014-10-15 06:00:00",
                     "2014-10-15 07:00:00",
                     "2014-10-15 08:00:00"
                 ],
                 "A37A87670740D9DF0FF05EB47872D955A730FDE2": [
                     "2014-10-15 09:00:00",
                     "2014-10-15 10:00:00",
                     "2014-10-15 11:00:00",
                     "2014-10-15 12:00:00",
                     "2014-10-15 13:00:00",
                     "2014-10-15 14:00:00",
                     "2014-10-15 15:00:00"
                 ]
             },
             "extrainfo_descriptors": {
                 "F96656C6ED7E3334C9253E7B4F91D6ECCE854DA1": [
                     "2014-10-14 16:00:00",
                     "2014-10-14 17:00:00",
                     "2014-10-14 18:00:00",
                     "2014-10-14 19:00:00",
                     "2014-10-14 20:00:00",
                     "2014-10-14 21:00:00",
                     "2014-10-14 22:00:00",
                     "2014-10-14 23:00:00",
                     "2014-10-15 00:00:00",
                     "2014-10-15 01:00:00",
                     "2014-10-15 02:00:00",
                     "2014-10-15 03:00:00",
                     "2014-10-15 04:00:00",
                     "2014-10-15 05:00:00",
                     "2014-10-15 06:00:00",
                     "2014-10-15 07:00:00",
                     "2014-10-15 08:00:00"
                 ],
                 "A8DC5276EEE740F210276DEC49026270FB2B1437": [
                     "2014-10-15 09:00:00",
                     "2014-10-15 10:00:00",
                     "2014-10-15 11:00:00",
                     "2014-10-15 12:00:00",
                     "2014-10-15 13:00:00",
                     "2014-10-15 14:00:00",
                     "2014-10-15 15:00:00"
                 ]
             },
             "micro_descriptors": {
                 "S+wzq/7JtC5fWkQmH3pxVprpdeWpGRLvrmKr6ZO/+3Y": [
                     "2014-10-14 16:00:00",
                     "2014-10-14 17:00:00",
                     "2014-10-14 18:00:00",
                     "2014-10-14 19:00:00",
                     "2014-10-14 20:00:00",
                     "2014-10-14 21:00:00",
                     "2014-10-14 22:00:00",
                     "2014-10-14 23:00:00",
                     "2014-10-15 00:00:00",
                     "2014-10-15 01:00:00",
                     "2014-10-15 02:00:00",
                     "2014-10-15 03:00:00",
                     "2014-10-15 04:00:00",
                     "2014-10-15 05:00:00",
                     "2014-10-15 06:00:00",
                     "2014-10-15 07:00:00",
                     "2014-10-15 08:00:00",
                     "2014-10-15 09:00:00",
                     "2014-10-15 10:00:00",
                     "2014-10-15 11:00:00",
                     "2014-10-15 12:00:00",
                     "2014-10-15 13:00:00",
                     "2014-10-15 14:00:00",
                     "2014-10-15 15:00:00"
                 ]
             }
         }
     ],
     "bridges_published": "2014-10-15 14:37:04",
     "bridges": []
 }
 }}}

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/13425>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online