[tor-bugs] #20647 [Core Tor/Tor]: Tor and Chutney CI improvements

Tor Bug Tracker & Wiki blackhole at torproject.org
Wed Jan 15 14:02:15 UTC 2020


#20647: Tor and Chutney CI improvements
-------------------------------------------------+-------------------------
 Reporter:  chelseakomlo                         |          Owner:  (none)
     Type:  enhancement                          |         Status:
                                                 |  assigned
 Priority:  High                                 |      Milestone:  Tor:
                                                 |  0.4.2.x-final
Component:  Core Tor/Tor                         |        Version:
 Severity:  Normal                               |     Resolution:
 Keywords:  test, chutney, consistency,          |  Actual Points:
  jenkins, integration-testing, continuous-      |
  integration, postfreeze-ok, teor-              |
  unreached-2019-03-08, tor-ci,                  |
  041-deferred-20190530, 042-can                 |
Parent ID:                                       |         Points:
 Reviewer:  weasel                               |        Sponsor:
-------------------------------------------------+-------------------------

Old description:

> It would be nice for chutney tests to be run on every build.
>
> However, because chutney tests cannot be entirely deterministic (although
> we can do more work to get them closer), this probably should not block
> the build if tests fail (at least for the short term & we eliminate as
> much flakiness as possible).

New description:

 We currently run chutney tests on every Tor and Chutney branch and pull
 request. We deal with non-determinism by allowing a small number of
 chutney failures, before reporting an overall test failure.

 But sometimes failures are hard to diagnose. This ticket is a parent
 ticket for improvements that help us diagnose chutney failures.

--

Comment (by teor):

 Update description.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/20647#comment:24>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online


More information about the tor-bugs mailing list