[tor-dev] Guardiness: Yet another external dirauth script
atagar at torproject.org
Tue Sep 16 15:06:42 UTC 2014
> - Q: Why do you slow stem instead of parsing consensuses with Python on your own?
> This is another part where I might have taken the wrong design
> decision, but I decided to not get into the consensus parsing business
> and just rely on stem.
> This is also because I was hoping to use stem to verify consensus
> signatures. However, now that we might use Daniel's patch to populate
> our consensus database, maybe we don't need to treat consensuses as
> untrusted anymore.
> If you think that I should try to parse the consensuses on my own,
> please tell me and I will give it a try. Maybe it will be
> fast. Definitely not as fast as summary files, but maybe we can parse
> 3 months worth of consesuses in 15 to 40 seconds.
I'm not sure why you think it was the wrong choice. If Stem isn't
providing you the performance you want then seems like speeding it up
is the right option rather than writing your own parser. That is, of
course, unless you're looking for something highly specialized in
which case have fun.
Nick improved parsing performance by around 30% in response to this...
Between that and turning off validation I'd be a little curious where
the time is going if it's still too slow for you.
More information about the tor-dev