[tor-bugs] #1854 [Analysis]: Investigate raising the minimum bandwidth for getting the Fast flag

[Tor Bug Tracker & Wiki]

#1854: Investigate raising the minimum bandwidth for getting the Fast flag
---------------------------------------+------------------------------------
 Reporter:  arma                       |          Owner:  arma        
     Type:  task                       |         Status:  needs_review
 Priority:  normal                     |      Milestone:              
Component:  Analysis                   |        Version:              
 Keywords:  performance loadbalancing  |         Parent:              
   Points:                             |   Actualpoints:              
---------------------------------------+------------------------------------
Changes (by gsathya):

  * status:  new => needs_review


Comment:

 Some background from Karsten's email -
   I usually take another approach for combining network statuses and
 server descriptors in an analysis: parse *all* server descriptors, extract
 the relevant parts, keep them in memory stored under their descriptor
 digest, parse consensuses, use server descriptor parts from memory.  This
 is faster, because we only have to parse a server descriptor once, not
 every time it's referenced from a consensus, which can be 12 times or
 more.  There's also the option to store intermediate results from parsing
 server descriptors in a temp file and only read that when re-running the
 analysis, which typically happens quite often.  This approach is also more
 efficient, because we can parse server descriptors contained in tarballs
 without extracting them.

 I've changed pylinf to be able to read a single tar file or a bunch of tar
 server descriptor files and store it in memory. I haven't had the chance
 to test it much, let me know if you find any bugs.

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/1854#comment:35>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online