[tor-bugs] #14780 [Onionoo]: very large file

[Tor Bug Tracker & Wiki]

#14780: very large file
---------------------+---------------------
 Reporter:  iwakeh   |          Owner:
     Type:  defect   |         Status:  new
 Priority:  normal   |      Milestone:
Component:  Onionoo  |        Version:
 Keywords:           |  Actual Points:
Parent ID:           |         Points:
---------------------+---------------------
 Once in a while the backend creates these huge files of several MB.
 Here the log excerpt:
 {{{
 o.t.o.d.DocumentStore:474 Retrieved very large document file:
 path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=57396605
 }}}

 When inspecting the file there is regular data and lots of binary garbage:
 {{{
 "desc_published":"2015-01-25 02:23:50","last_restarted":"2015-01-22
 23:19:46","bandwidth_rate":196608,"bandwidth_burst":393216,"observed_bandwidth":61090,"advertised_bandwidth":61090,"exit_policy":["reject
 *:*"],"contact":"ContactInfo williamsantiago at protonmail dot ch  -
 1B9iz8sYqN7vqCi9MkidmmDLvwQwXyjZDL","platform":"Tor 0.2.4.23 on Windows
 8","is_relay":true,"running":false,"nickname":"gandules","address":"190.88.225.164","or_addresses_and_ports":[],"first_seen_millis":1421337600000,"last_seen_millis":1421337600000,"or_port":444,"dir_port":0,"relay_flags":["Running","Valid"],"consensus_weight":20,"default_policy":"reject","port_list":"1-65535","last_changed_or_address_or_port":1421337600000,"recommended_version":true,"exit_addresses":{},"latitude":12.1,"longitude":-68.9167,"country_code":"cw","country_name":"Cura���
 }}}
 The logs show that this file accumulated during several runs (size at the
 end of each line):
 {{{
 Attempting to store very large document file: path='/home/onionoo/onionoo-
 master/out/details/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=1654280
  Attempting to store very large document file: path='/home/onionoo
 /onionoo-master/out/details/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=4961024
  Retrieved very large document file: path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=2126739
  Retrieved very large document file: path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=2126739
  Attempting to store very large document file: path='/home/onionoo
 /onionoo-master/out/details/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=14881256
  Retrieved very large document file: path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=2126739
  Attempting to store very large document file: path='/home/onionoo
 /onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=2126739
  Retrieved very large document file: path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=6378267
  Attempting to store very large document file: path='/home/onionoo
 /onionoo-master/out/details/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=44641952
  Retrieved very large document file: path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=6378267
  Attempting to store very large document file: path='/home/onionoo
 /onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=6378269
  Retrieved very large document file: path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=19132853
  Attempting to store very large document file: path='/home/onionoo
 /onionoo-master/out/details/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=133924042
  Retrieved very large document file: path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=19132853
  Attempting to store very large document file: path='/home/onionoo
 /onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=19132853
  Retrieved very large document file: path='/home/onionoo/onionoo-
 master/status/details/1/3/13CE6B3790B206FD6A63023A39D3FB9F1CCBDC7C',
 bytes=57396605
 }}}

 Did such a behavior occur before?

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/14780>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online