[tor-bugs] #31204 [Metrics/CollecTor]: Extend file objects in index.json to include descriptor types, publication times, and file digests

[Tor Bug Tracker & Wiki]

#31204: Extend file objects in index.json to include descriptor types, publication
times, and file digests
-------------------------------+--------------------------
 Reporter:  karsten            |          Owner:  karsten
     Type:  enhancement        |         Status:  accepted
 Priority:  Medium             |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+--------------------------

Comment (by karsten):

 I now have a running version of the "slightly more complex" implementation
 mentioned above. It still contains a dozen TODOs and needs more testing,
 but I don't see any major blockers anymore.

 Here's a sample output `index.json` file produced by my code:

 {{{
 {
   "index_created": "2019-10-24 14:40",
   "build_revision": "f602b218",
   "path": "https://collector.torproject.org",
   "directories": [
     {
       "path": "archive",
       "directories": [
         {
           "path": "relay-descriptors",
           "directories": [
             {
               "path": "consensuses",
               "files": [
                 {
                   "path": "consensuses-2019-10.tar.xz",
                   "size": 16798840,
                   "last_modified": "2019-10-23 03:44",
                   "types": [
                     "network-status-consensus-3 1.0"
                   ],
                   "first_published": "2019-10-01 00:00",
                   "last_published": "2019-10-23 03:00",
                   "sha256": "d8fhWyp3Gft/uFD4x1Fwu4IcBJsj6xGb2r/J3UzAZB8="
                 }
               ]
             }
           ]
         }
       ]
     }
   ]
 }
 }}}

 Any thoughts on this output before I finalize my code and put it here for
 review?

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/31204#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online