[tor-bugs] #9379 [Tor]: Tor descriptor fetching is unreliable

[Tor Bug Tracker & Wiki]

#9379: Tor descriptor fetching is unreliable
--------------------+-------------------------------------------------------
 Reporter:  atagar  |          Owner:     
     Type:  defect  |         Status:  new
 Priority:  normal  |      Milestone:     
Component:  Tor     |        Version:     
 Keywords:          |         Parent:     
   Points:          |   Actualpoints:     
--------------------+-------------------------------------------------------

Comment(by atagar):

 Now that maatuska is back up I re-ran the above puller with compression.
 The 'truncated stream' errors look to be the only frequent issue...

 {{{
 atagar at odin:~/Desktop/tor/tor-utils$ python puller.py
 08/05/2013 08:39:43 [DEBUG] Unable to download descriptors from
 'http://194.109.206.212:80/tor/server/all.z' (2 retries remaining): Error
 -5 while decompressing data: incomplete or truncated stream
 08/05/2013 08:40:00 [DEBUG] Unable to download descriptors from
 'http://208.83.223.34:443/tor/server/all.z' (1 retries remaining): Error
 -5 while decompressing data: incomplete or truncated stream
 08/05/2013 08:40:25 [DEBUG] Unable to download descriptors from
 'http://128.31.0.39:9131/tor/server/all.z': Error -5 while decompressing
 data: incomplete or truncated stream
 Got an error: Error -5 while decompressing data: incomplete or truncated
 stream
 08/05/2013 08:40:44 [TRACE] Descriptors retrieved from
 'http://212.112.245.170:80/tor/server/all.z' in 18.61s
 Results downloaded: 5814
 08/05/2013 08:41:19 [TRACE] Descriptors retrieved from
 'http://86.59.21.38:80/tor/server/all.z' in 18.06s
 Results downloaded: 5813
 08/05/2013 08:42:28 [DEBUG] Unable to download descriptors from
 'http://76.73.17.194:9030/tor/server/all.z' (2 retries remaining): Error
 -5 while decompressing data: incomplete or truncated stream
 08/05/2013 08:42:46 [DEBUG] Unable to download descriptors from
 'http://194.109.206.212:80/tor/server/all.z' (1 retries remaining): Error
 -5 while decompressing data: incomplete or truncated stream
 08/05/2013 08:43:05 [TRACE] Descriptors retrieved from
 'http://212.112.245.170:80/tor/server/all.z' in 18.82s
 Results downloaded: 5813
 08/05/2013 08:43:41 [DEBUG] Unable to download descriptors from
 'http://194.109.206.212:80/tor/server/all.z' (2 retries remaining): Error
 -5 while decompressing data: incomplete or truncated stream
 }}}

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/9379#comment:4>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online