30 Aug
2018
30 Aug
'18
9:35 p.m.
On 29 August 2018 at 16:11, Mike Perry mikeperry@torproject.org wrote:
Ideally, I would like us to perform A/B experiments to ensure that our performance metrics do not degrade in terms of average *or* quartile range/performance variance. (Ie: alternate torflow results for a week vs sbws for a week, and repeat for a few weeks). I realize this might be complicated for dirauth operators, though. Can we make it easier somehow, so that it is easy to switch which result files they are voting with?
Having both voting files means running both scanners at the same time. Depending on one's pipes, that might skew the results from the scanners.
-tom