[tor-bugs] #4015 [Torflow]: BwAuthority postgres scanner freezes with changes from #3679 TorCtl Event Parsing Rewrite

[Tor Bug Tracker & Wiki]

#4015: BwAuthority postgres scanner freezes with changes from #3679 TorCtl Event
Parsing Rewrite
---------------------+------------------------------------------------------
 Reporter:  aagbsn   |          Owner:  mikeperry
     Type:  defect   |         Status:  new      
 Priority:  major    |      Milestone:           
Component:  Torflow  |        Version:           
 Keywords:           |         Parent:  #3679    
   Points:           |   Actualpoints:           
---------------------+------------------------------------------------------

Comment(by aagbsn):

 BwAuthority is spending a lot of time waiting to get consensus and not
 doing much else.

 {{{
 (torflow)bwscanner at tor:~/tor/torflow/NetworkScanners/BwAuthority$ grep
 "Not enough router descriptors" data/scanner.1/bw.log | wc -l
 174777
 (torflow)bwscanner at tor:~/tor/torflow/NetworkScanners/BwAuthority$ grep
 "Not enough router descriptors" data/scanner.2/bw.log | wc -l
 138768
 (torflow)bwscanner at tor:~/tor/torflow/NetworkScanners/BwAuthority$ grep
 "Not enough router descriptors" data/scanner.3/bw.log | wc -l
 148491
 (torflow)bwscanner at tor:~/tor/torflow/NetworkScanners/BwAuthority$ grep
 "Not enough router descriptors" data/scanner.4/bw.log | wc -l
 144698
 }}}

 See these WARNs:
 {{{
 INFO[Sat Oct 08 14:09:33 2011]:Waiting on consensus result: False
 INFO[Sat Oct 08 14:09:33 2011]:Router descriptor for
 019EF7DBC8D67CCCA755128EF73D118E381E09EC does not match ns fingerprint (NS
 @ 2011-10-08 00:52:35 vs Desc @ 2011-10-08 18:53:20)
 WARN[Sat Oct 08 14:09:33 2011]:No router desc for
 019EF7DBC8D67CCCA755128EF73D118E381E09EC after NEWDESC
 DEBUG[Sat Oct 08 14:09:33 2011]:68656.1056559 Read 1 ND => 218 routers.
 Update: False
 INFO[Sat Oct 08 14:09:33 2011]:Consensus change... Updating db
 INFO[Sat Oct 08 14:09:39 2011]:Consensus db updated
 INFO[Sat Oct 08 14:09:39 2011]:Waiting on consensus result: False
 INFO[Sat Oct 08 14:09:39 2011]:Router descriptor for
 01EE3D06EB598F62A35A30DDB614F7D48F7E5EE4 does not match ns fingerprint (NS
 @ 2011-10-08 00:55:02 vs Desc @ 2011-10-08 18:55:46)
 WARN[Sat Oct 08 14:09:39 2011]:No router desc for
 01EE3D06EB598F62A35A30DDB614F7D48F7E5EE4 after NEWDESC
 DEBUG[Sat Oct 08 14:09:39 2011]:68662.0935042 Read 1 ND => 218 routers.
 Update: False
 INFO[Sat Oct 08 14:09:39 2011]:Consensus change... Updating db
 INFO[Sat Oct 08 14:09:41 2011]:Consensus db updated
 INFO[Sat Oct 08 14:09:41 2011]:Waiting on consensus result: False
 INFO[Sat Oct 08 14:09:42 2011]:Router descriptor for
 09F64E00F34C88F604163F24D37BEAF9245702EA does not match ns fingerprint (NS
 @ 2011-10-08 01:09:46 vs Desc @ 2011-10-08 19:10:41)
 WARN[Sat Oct 08 14:09:42 2011]:No router desc for
 09F64E00F34C88F604163F24D37BEAF9245702EA after NEWDESC
 DEBUG[Sat Oct 08 14:09:42 2011]:68650.4785399 Read 1 ND => 218 routers.
 Update: False
 INFO[Sat Oct 08 14:09:42 2011]:Consensus change... Updating db
 INFO[Sat Oct 08 14:09:43 2011]:Consensus db updated
 INFO[Sat Oct 08 14:09:43 2011]:Waiting on consensus result: False
 INFO[Sat Oct 08 14:09:43 2011]:Router descriptor for
 0F241A5759BC0BA2C14D085B7E614751C82C70F9 does not match ns fingerprint (NS
 @ 2011-10-08 01:31:59 vs Desc @ 2011-10-08 18:11:42)
 WARN[Sat Oct 08 14:09:43 2011]:No router desc for
 0F241A5759BC0BA2C14D085B7E614751C82C70F9 after NEWDESC
 DEBUG[Sat Oct 08 14:09:43 2011]:68652.445874 Read 1 ND => 218 routers.
 Update: False
 INFO[Sat Oct 08 14:09:44 2011]:Consensus change... Updating db
 INFO[Sat Oct 08 14:09:44 2011]:Consensus db updated
 }}}

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/4015#comment:7>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online