[tor-bugs] #17321 [CollecTor]: Index to better support downloaders

[Tor Bug Tracker & Wiki]

#17321: Index to better support downloaders
-----------------------------+-----------------
     Reporter:  atagar       |      Owner:
         Type:  enhancement  |     Status:  new
     Priority:  major        |  Milestone:
    Component:  CollecTor    |    Version:
   Resolution:               |   Keywords:
Actual Points:               |  Parent ID:
       Points:               |    Sponsor:
-----------------------------+-----------------

Comment (by atagar):

 > What do you think, should we move forward with this?

 Yikes, I'm surprised you put this together so quickly. This is great, lets
 do it!

 > "path": "/srv/collector.torproject.org/htdocs/",

 The filesystem path is being used for the first entry. This threw me off
 for a sec. In the example above you have
 "https://collector.torproject.org/" which made a bit more sense for the
 root.

 > "last_modified": "2014-07-07 09:15"

 You mentioned above that you wanted to switch to ISO timestamps. That, or
 these timestamp (which tor uses) are both fine to me as long as it's UTC.

 Personally I'm still not clear on its use though. I care about 'what time
 period are the descriptors in this resource for'. I don't have a use case
 at the moment for last modified timestamps, though if you have need for
 them then feel free to include them.

 If we're certain they're needed include them. If unsure I'd suggest
 leaving them out for now to cut down on the size. We can always add them
 later.

 > "path": "exit-lists/",

 Very minor but personally I'd opt to not include the trailing slash. It
 doesn't add anything. But that's definitely in bikeshed territory. :P

 One general suggestion: lets put the whole thing in a 'contents' entry so
 we can include additional metadata. For instance, 'when was this index
 created' could be very useful to help detect if the script keeping it up
 to date broke...

 {{{
 {
   "index_created": "2014-06-05 10:52",
   "contents":
     ... all the stuff...
   }
 }
 }}}

 More fields might come into play in the future.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/17321#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online