[tor-bugs] #29729 [Core Tor/Chutney]: Work out which networks to run in Chutney's CI

[Tor Bug Tracker & Wiki]

#29729: Work out which networks to run in Chutney's CI
-------------------------------------------------+-------------------------
 Reporter:  teor                                 |          Owner:  teor
     Type:  enhancement                          |         Status:
                                                 |  assigned
 Priority:  Medium                               |      Milestone:
Component:  Core Tor/Chutney                     |        Version:
 Severity:  Normal                               |     Resolution:
 Keywords:  chutney-ci, network-team-            |  Actual Points:
  roadmap-2019-Q1Q2                              |
Parent ID:                                       |         Points:  1
 Reviewer:                                       |        Sponsor:
                                                 |  Sponsor19
-------------------------------------------------+-------------------------

Comment (by teor):

 I have a nice diagram paper diagram for our different CI dimensions. I'll
 work out how to put the final version in text.

 Here's a list of the networks that tor's `make test-network-all` runs. We
 need to test all these networks, because breaking them would break Tor's
 CI.

 0.2.9:
 basic-min
 bridges-min
 hs-min
 single-onion
 bridges+ipv6-min
 ipv6-exit-min
 hs-ipv6
 single-onion-ipv6

 0.3.4 and later:
 basic-min
 bridges-min
 hs-v2-min
 hs-v3-min
 single-onion-v23
 bridges+ipv6-min
 ipv6-exit-min
 hs-v23-ipv6-md
 single-onion-ipv6-md

 Here's a list of the network sets and arguments I want to test:

 No Tor installed (?):
 * --dry-run

 master only:
 * --coverage --debug --all-warnings
 * --quiet --no-warnings
 * --net-dir `mktemp -d`
 * --data 100000000 (or 10s worth) --start-time 70 --bootstrap-time 70
 --stop-time 10 --rounds 2 --connections 2

 0.2.9 and master:
 * bridges networks
 * --offline (Mac & Linux)

 0.2.9, 0.3.4, and master:
 * onion networks
 * IPv6 networks --ipv4 127.0.0.1 --ipv6 :1

 This seems like a lot, but we only modify chutney once a week (or less).
 So we can afford to do exhaustive tests.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/29729#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online