[tor-bugs] #20323 [Metrics/metrics-lib]: avoid httpurl connection and use more robust approach

[Tor Bug Tracker & Wiki]

#20323: avoid httpurl connection and use more robust approach
---------------------------------+-----------------------------------
 Reporter:  iwakeh               |          Owner:  karsten
     Type:  defect               |         Status:  new
 Priority:  High                 |      Milestone:  metrics-lib 2.0.0
Component:  Metrics/metrics-lib  |        Version:
 Severity:  Normal               |     Resolution:
 Keywords:                       |  Actual Points:
Parent ID:                       |         Points:
 Reviewer:                       |        Sponsor:
---------------------------------+-----------------------------------
Changes (by karsten):

 * priority:  Medium => High


Comment:

 It might be that this issue killed the relaydescs module 1.5 days ago by
 blocking the downloader indefinitely:

 {{{
 2016-10-30 23:05:00,000 INFO o.t.c.c.CollecTorMain:54 Starting relaydescs
 module of CollecTor.
 2016-10-30 23:05:20,823 INFO o.t.c.r.CachedRelayDescriptorReader:255
 Finished importing relay descriptors from local Tor data directories:
 cached-consensus: 2016-10-30 23:00:00
 cached-descriptors: parsed 0, skipped 24471 server descriptors
 cached-descriptors.new: parsed 753, skipped 6024 server descriptors
 cached-extrainfo: parsed 0, skipped 24508 extra-info descriptors
 cached-extrainfo.new: parsed 745, skipped 1463 extra-info descriptors
 v3-status-votes: parsed 8, skipped 0 votes
 2016-10-30 23:06:00,001 INFO o.t.c.c.CollecTorMain:54 Starting updateindex
 module of CollecTor.
 }}}

 There should be a line like this (copied over from the previous run), but
 there wasn't:

 {{{
 2016-10-30 22:35:19,933 INFO o.t.c.r.RelayDescriptorDownloader:1067
 Finished downloading relay descriptors from the directory authorities.
 }}}

 Raising priority to high.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/20323#comment:3>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online