[tor-bugs] #17321 [CollecTor]: Index to better support downloaders

[Tor Bug Tracker & Wiki]

#17321: Index to better support downloaders
-------------------------+---------------------
 Reporter:  atagar       |          Owner:
     Type:  enhancement  |         Status:  new
 Priority:  High         |      Milestone:
Component:  CollecTor    |        Version:
 Severity:  Major        |     Resolution:
 Keywords:               |  Actual Points:
Parent ID:               |         Points:
  Sponsor:               |
-------------------------+---------------------

Comment (by atagar):

 > What do you think?

 Looks good to me! I was worrying a bit about size (especially if we add
 new fields like the descriptor type), but on reflection this includes a
 lot of repeated bits ('bridge-descriptors-' and such). That compresses
 very, very nicely.

 Your example index.json (237.9 kB) can be gz compressed to 39.7 kB, bz2
 compressed to 30.5 kB, or xz compressed to 26.6 kB. If reasonably easy it
 would be nice if CollecTor provided the index with all three. With python
 at least [https://stem.torproject.org/faq.html#how-do-i-read-tar-xz-
 descriptor-archives builtin xz support wasn't added until python 3.3].

 Cheers! -Damian

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/17321#comment:9>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online