[tor-bugs] #32804 [Core Tor/Tor]: Travis CI hangs during compile or test

[Tor Bug Tracker & Wiki]

#32804: Travis CI hangs during compile or test
-------------------------------------------------+-------------------------
 Reporter:  teor                                 |          Owner:  (none)
     Type:  defect                               |         Status:
                                                 |  needs_information
 Priority:  Medium                               |      Milestone:  Tor:
                                                 |  0.4.3.x-final
Component:  Core Tor/Tor                         |        Version:  Tor:
                                                 |  unspecified
 Severity:  Normal                               |     Resolution:
 Keywords:  tor-ci-rarely-fail, tor-test, hang,  |  Actual Points:
  tor-ci, 043-should                             |
Parent ID:  #29645                               |         Points:  1
 Reviewer:                                       |        Sponsor:
-------------------------------------------------+-------------------------
Changes (by teor):

 * status:  new => needs_information


Comment:

 I sent this email to support at travis ci, following their CI support
 issue template:

 Hi,

 We are seeing about half our macOS jobs hang, even though
 https://www.traviscistatus.com/ shows:
 * no incidents
 * 100% uptime for macOS builds

 Hangs have been happening intermittently for the past week or two,
 but it became severe from approximately Monday 16 March 1100 UTC
 to Monday 16 March 1600 UTC.

 Since Monday 16 March 1600 UTC we have run 6 macOS jobs, and they
 have all passed.

 Last time a similar issue happened, I asked:

 Are you going to make changes to http://www.traviscistatus.com/ so
 that this kind of failure is visible?

 Are you going to change your monitoring so you discover issues
 like this earlier?

 - GitHub accounts

 torproject

 - Repository names

 torproject/tor

 - Explanation of the issue

 macOS jobs hang during the build, at:
 * git clone x2
 * setting up build cache
 * configure x2
 * compile x2

 There doesn't seem to be any particular CI stage or command
 that triggers the issue.

 - Copy of the error message (if any)

 No output has been received in the last 10m0s, this potentially indicates
 a stalled build or something wrong with the build itself.
 Check the details on how to adjust your build configuration on:
 https://docs.travis-ci.com/user/common-build-problems/#Build-times-out-
 because-no-output-was-received
 The build has been terminated

 - Link to a specific build showing the issue

 Here are the failed jobs:

 https://travis-ci.org/github/torproject/tor/jobs/663014823
 https://travis-ci.org/github/torproject/tor/jobs/663014930
 https://travis-ci.org/github/torproject/tor/jobs/663015119
 https://travis-ci.org/github/torproject/tor/jobs/663015215
 https://travis-ci.org/github/torproject/tor/jobs/663015346
 https://travis-ci.org/github/torproject/tor/jobs/663015421
 https://travis-ci.org/github/torproject/tor/jobs/663015422

 Here are the first few successful jobs since the failure rate decreased:

 https://travis-ci.org/github/torproject/tor/jobs/663098299
 https://travis-ci.org/github/torproject/tor/jobs/663098300
 https://travis-ci.org/github/torproject/tor/jobs/663144316
 https://travis-ci.org/github/torproject/tor/jobs/663144317

 Here is a failed job from last week:

 https://travis-ci.org/github/torproject/tor/jobs/661800891

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/32804#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online