[tor-bugs] #29729 [Core Tor/Chutney]: Work out which networks to run in Chutney's CI

[Tor Bug Tracker & Wiki]

#29729: Work out which networks to run in Chutney's CI
------------------------------+---------------------------
 Reporter:  teor              |          Owner:  teor
     Type:  enhancement       |         Status:  assigned
 Priority:  Medium            |      Milestone:
Component:  Core Tor/Chutney  |        Version:
 Severity:  Normal            |     Resolution:
 Keywords:  chutney-ci        |  Actual Points:
Parent ID:  #27912            |         Points:  1
 Reviewer:                    |        Sponsor:  Sponsor19
------------------------------+---------------------------

Comment (by teor):

 We can do all these networks on Linux.
 We also need to do the offline network on macOS.

 Here's the reasoning:
 * we want to find out if changes to chutney break an important feature
 * to get a minimal matrix, we want to check all plausible independent
 failures
 * so we only need to test features on multiple OSes / Tor versions /
 python versions if a chutney change could break the feature on one matrix
 alternative, but not the others

 For example:
 * offline/online work differently enough on macOS and Linux that we need
 to test them on both
 * we'll already test v2 onion services on Tor's CI for the 0.2.9 branch,
 and v2 and v3 on all other Tor CI branches
 * all other features are essentially the same across OSes, Tor versions,
 and python versions

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/29729#comment:2>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online