[tor-bugs] #13600 [Onionoo]: Improve bulk imports of descriptor archives

[Tor Bug Tracker & Wiki]

#13600: Improve bulk imports of descriptor archives
-----------------------------+-----------------
     Reporter:  karsten      |      Owner:
         Type:  enhancement  |     Status:  new
     Priority:  normal       |  Milestone:
    Component:  Onionoo      |    Version:
   Resolution:               |   Keywords:
Actual Points:               |  Parent ID:
       Points:               |
-----------------------------+-----------------

Comment (by leeroy):

 Sorry for the delay. I've now checked re-parsing identical data with the
 following results.

  * Reprocessing data rewrites the timestamp of
 last_changed_or_address_or_port from a valid value to -1.
  * The host_name key gets removed. I did see this before. I believe this
 depends on the rdns resolving component failing. I use a system tor for
 dns resolution so this makes sense (and sounds mostly harmless).

 That's it, besides the artifacts mentioned previously. This all combines
 to produce smaller data stores after reprocessing. If rewriting
 last_changed_or_address_or_port sounds harmless too then I think this
 ticket can be closed now that the branch was merged. The rest can be
 handled in their own tickets.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/13600#comment:12>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online