March 2022 - metrics-alerts - lists.torproject.org

** PROBLEM Service Alert: onionoo-frontend-02/network service - onionoo full service check is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 04 Mar '22

04 Mar '22

***** Icinga ***** Notification Type: PROBLEM Service: network service - onionoo full service check Host: onionoo-frontend-02 Address: 49.12.57.137 State: WARNING Date/Time: Fri Mar 4 14:34:33 UTC 2022 Additional Info: WARNING: Either timestamp is not recent (16463 sec): relays_published=2022-03-04 10:00:00, bridges_published=2022-03-04 10:41:25

1 0

** RECOVERY Service Alert: onionoo-frontend-02/network service - onionoo varnish is OK **
by nagios＠hetzner-hel1-01.torproject.org 04 Mar '22

04 Mar '22

***** Icinga ***** Notification Type: RECOVERY Service: network service - onionoo varnish Host: onionoo-frontend-02 Address: 49.12.57.137 State: OK Date/Time: Fri Mar 4 13:57:13 UTC 2022 Additional Info: OK: Valid response with recent timestamps (4540 sec): relays_published=2022-03-04 13:00:00, bridges_published=2022-03-04 12:41:25

1 0

** RECOVERY Service Alert: onionoo-frontend-02/network service - onionoo full service check is OK **
by nagios＠hetzner-hel1-01.torproject.org 04 Mar '22

04 Mar '22

***** Icinga ***** Notification Type: RECOVERY Service: network service - onionoo full service check Host: onionoo-frontend-02 Address: 49.12.57.137 State: OK Date/Time: Fri Mar 4 13:39:33 UTC 2022 Additional Info: OK: Valid response with recent timestamps (3478 sec): relays_published=2022-03-04 13:00:00, bridges_published=2022-03-04 12:41:25

1 0

** PROBLEM Service Alert: onionoo-frontend-01/network service - onionoo full service check is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 04 Mar '22

04 Mar '22

***** Icinga ***** Notification Type: PROBLEM Service: network service - onionoo full service check Host: onionoo-frontend-01 Address: 116.202.120.171 State: WARNING Date/Time: Fri Mar 4 13:25:13 UTC 2022 Additional Info: WARNING: Either timestamp is not recent (12305 sec): relays_published=2022-03-04 10:00:00, bridges_published=2022-03-04 10:41:25

1 0

** PROBLEM Service Alert: onionoo-frontend-02/network service - onionoo full service check is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 04 Mar '22

04 Mar '22

***** Icinga ***** Notification Type: PROBLEM Service: network service - onionoo full service check Host: onionoo-frontend-02 Address: 49.12.57.137 State: WARNING Date/Time: Fri Mar 4 13:24:33 UTC 2022 Additional Info: WARNING: Either timestamp is not recent (12263 sec): relays_published=2022-03-04 10:00:00, bridges_published=2022-03-04 10:41:25

1 0

** PROBLEM Service Alert: onionoo-backend-02/network service - onionoo varnish is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 04 Mar '22

04 Mar '22

***** Icinga ***** Notification Type: PROBLEM Service: network service - onionoo varnish Host: onionoo-backend-02 Address: 116.202.120.178 State: WARNING Date/Time: Fri Mar 4 13:21:23 UTC 2022 Additional Info: WARNING: Either timestamp is not recent (12075 sec): relays_published=2022-03-04 10:00:00, bridges_published=2022-03-04 10:41:25

1 0

** PROBLEM Service Alert: onionoo-frontend-02/network service - onionoo varnish is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 04 Mar '22

04 Mar '22

***** Icinga ***** Notification Type: PROBLEM Service: network service - onionoo varnish Host: onionoo-frontend-02 Address: 49.12.57.137 State: WARNING Date/Time: Fri Mar 4 13:12:13 UTC 2022 Additional Info: WARNING: Either timestamp is not recent (11525 sec): relays_published=2022-03-04 10:00:00, bridges_published=2022-03-04 10:41:25

1 0

** PROBLEM Service Alert: onionoo-backend-02/network service - onionoo backend is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 04 Mar '22

04 Mar '22

***** Icinga ***** Notification Type: PROBLEM Service: network service - onionoo backend Host: onionoo-backend-02 Address: 116.202.120.178 State: WARNING Date/Time: Fri Mar 4 13:11:33 UTC 2022 Additional Info: WARNING: Either timestamp is not recent (11488 sec): relays_published=2022-03-04 10:00:00, bridges_published=2022-03-04 10:41:25

1 0

Cron <onionoo@onionoo-backend-02> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-02.torproject.org 03 Mar '22

03 Mar '22

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 11, in <module> details = json.loads(requests.get("https://onionoo.torproject.org/details").text) File "/usr/lib/python3.7/json/__init__.py", line 348, in loads return _default_decoder.decode(s) File "/usr/lib/python3.7/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.7/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

1 0

Cron <onionoo@onionoo-backend-02> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-02.torproject.org 03 Mar '22

03 Mar '22

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 237, in <module> if len(flags) > 0: TypeError: object of type 'NoneType' has no len()

1 0