[tor-bugs] #29693 [Core Tor/Tor]: Decrease probability of stochastic failures in test-slow

Tor Bug Tracker & Wiki blackhole at torproject.org
Fri Mar 8 09:33:55 UTC 2019


#29693: Decrease probability of stochastic failures in test-slow
-------------------------------+----------------------------------------
     Reporter:  teor           |      Owner:  (none)
         Type:  defect         |     Status:  new
     Priority:  High           |  Milestone:  Tor: 0.4.0.x-final
    Component:  Core Tor/Tor   |    Version:  Tor: 0.4.0.1-alpha
     Severity:  Normal         |   Keywords:  tor-ci, tor-test, 040-must
Actual Points:                 |  Parent ID:
       Points:  0.5            |   Reviewer:
      Sponsor:  Sponsor2-must  |
-------------------------------+----------------------------------------
 Our stochastic tests are supposed to fail around 1 in 100 runs. But when
 I'm doing a backport to 0.2.9, there are up to 14 jobs times 9 branches,
 each of which runs a test instance.

 So let's decrease the probability to about 1 in (100 * 14 * 9).

 Here's what the output looks like:
 {{{
 slow/prob_distr/stochastic_uniform: [forking] fail uniform sampler
   FAIL src/test/test_prob_distr.c:1209: assert(ok)
 NOTE: This is a stochastic test, and we expect it to fail from
 time to time, with some low probability. If you see it fail more
 than one trial in 100, though, please tell us.
 Seed: 5DB9A3B32C29B76D7A0032700DD142BB
   [stochastic_uniform FAILED]
 }}}
 https://travis-ci.org/torproject/tor/jobs/503432646#L5845

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/29693>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online


More information about the tor-bugs mailing list