March 2023 - metrics-alerts - lists.torproject.org

[FIRING:1] Relays per country MEDIUM
by alertmanager＠hetzner-nbg1-02.torproject.org 27 Mar '23

27 Mar '23

Total firing alerts: 1 Total resolved alerts: 0 ## Firing Alerts ----- Time: 2023-03-27 23:12:27.544031668 +0000 UTC Summary: More than 50 relays have joined the network from "us" Description: More than 50 relays from "us" have joined the network in the last 24 hours. ----- ##Resolved Alerts

1 0

[FIRING:1] Relays per contact string MEDIUM
by alertmanager＠hetzner-nbg1-02.torproject.org 27 Mar '23

27 Mar '23

Total firing alerts: 1 Total resolved alerts: 0 ## Firing Alerts ----- Time: 2023-03-27 22:12:27.544031668 +0000 UTC Summary: More than 10 relays have joined the network with the contact string "None" Description: More than 10 relays have joined the network with the contact string "None" in the last 2 hours. ----- ##Resolved Alerts

1 0

[FIRING:3] Relays per Flag MEDIUM
by alertmanager＠hetzner-nbg1-02.torproject.org 27 Mar '23

27 Mar '23

Total firing alerts: 3 Total resolved alerts: 0 ## Firing Alerts ----- Time: 2023-03-27 22:12:27.544031668 +0000 UTC Summary: More than 50 relays have joined the network with "Running" flag Description: More than 50 relays with "Running" flag have joined the network in the last 2 hours. ----- ----- Time: 2023-03-27 22:12:27.544031668 +0000 UTC Summary: More than 50 relays have joined the network with "Stable" flag Description: More than 50 relays with "Stable" flag have joined the network in the last 2 hours. ----- ----- Time: 2023-03-27 22:12:27.544031668 +0000 UTC Summary: More than 50 relays have joined the network with "Valid" flag Description: More than 50 relays with "Valid" flag have joined the network in the last 2 hours. ----- ##Resolved Alerts

1 0

[FIRING:1] Tor DNS EL Freshness
by alertmanager＠hetzner-nbg1-02.torproject.org 27 Mar '23

27 Mar '23

Total firing alerts: 1 Total resolved alerts: 0 ## Firing Alerts ----- Time: 2023-03-27 22:05:57.544031668 +0000 UTC Summary: Tor DNS Exits List has not been updated in the last 60 minutes or more Description: Tor DNS Exits List has not been updated for more than 60 ----- ##Resolved Alerts

1 0

[FIRING:1] Onionperf disk space
by alertmanager＠hetzner-nbg1-02.torproject.org 27 Mar '23

27 Mar '23

Total firing alerts: 1 Total resolved alerts: 0 ## Firing Alerts ----- Time: 2023-03-27 21:46:12.544031668 +0000 UTC Summary: op-hk6a.onionperf.torproject.net:9100 is using 95.02204151997452% of disk space available. Description: op-hk6a.onionperf.torproject.net:9100 disk space used is more than 95% ----- ##Resolved Alerts

1 0

** RECOVERY Service Alert: global/collector is OK **
by nagios＠hetzner-hel1-01.torproject.org 27 Mar '23

27 Mar '23

***** Icinga ***** Notification Type: RECOVERY Service: collector Host: global Address: global State: OK Date/Time: Mon Mar 27 20:07:17 UTC 2023 Additional Info: OK: Got a valid response from https://collector.torproject.org/index/index.json with recent timestamps: /archive/bridgedb-metrics/ = 2023-03-27 05:10 (14 72 hours ago), /archive/bridge-descriptors/extra-infos/ = 2023-03-27 05:17 (14 72 hours ago), /archive/bridge-descriptors/server-descriptors/ = 2023-03-27 05:09 (14 72 hours ago), /archive/bridge-descriptors/statuses/ = 2023-03-27 04:53 (15 72 hours ago), /archive/bridge-pool-assignments/ = 2023-03-27 05:10 (14 72 hours ago), /archive/exit-lists/ = 2023-03-27 03:26 (16 72 hours ago), /archive/onionperf/ = 2023-03-27 03:27 (16 72 hours ago), /archive/relay-descriptors/ = 2023-03-27 03:26 (16 720 hours ago), /archive/relay-descriptors/bandwidths/ = 2023-03-27 04:27 (15 72 hours ago), /archive/relay-descriptors/consensuses/ = 2023-03-27 03:31 (16 72 hours ago), /archive/relay-descriptors/extra-infos/ = 2023-03-27 04:57 (15 72 hours ago), /archive/relay-descriptors/microdescs/ = 2023-03-27 03:30 (16 72 hours ago), /archive/r elay-descriptors/server-descriptors/ = 2023-03-27 04:43 (15 72 hours ago), /archive/relay-descriptors/votes/ = 2023-03-27 04:51 (15 72 hours ago), /archive/snowflakes/ = 2023-03-27 05:09 (14 72 hours ago), /archive/webstats/ = 2023-03-27 05:17 (14 72 hours ago), /recent/bridgedb-metrics/ = 2023-03-26 21:40 (22 60 hours ago), /recent/bridge-descriptors/extra-infos/ = 2023-03-27 19:09 (0 3 hours ago), /recent/bridge-descriptors/server-descriptors/ = 2023-03-27 19:09 (0 3 hours ago), /recent/bridge-descriptors/statuses/ = 2023-03-27 19:09 (0 3 hours ago), /recent/bridge-pool-assignments/ = 2023-03-27 00:09 (19 30 hours ago), /recent/exit-lists/ = 2023-03-27 20:02 (0 3 hours ago), /recent/onionperf/ = 2023-03-27 02:11 (17 30 hours ago), /recent/relay-descriptors/bandwidths/ = 2023-03-27 19:37 (0 3 hours ago), /recent/relay-descriptors/consensuses/ = 2023-03-27 19:05 (1 3 hours ago), /recent/relay-descriptors/extra-infos/ = 2023-03-27 19:05 (1 3 hours ago), /recent/relay-de scriptors/microdescs/consensus-microdesc/ = 2023-03-27 19:05 (1 3 hours ago), /recent/relay-descriptors/microdescs/micro/ = 2023-03-27 19:05 (1 3 hours ago), /recent/relay-descriptors/server-descriptors/ = 2023-03-27 19:05 (1 3 hours ago), /recent/relay-descriptors/votes/ = 2023-03-27 19:05 (1 3 hours ago), /recent/snowflakes/ = 2023-03-27 17:40 (2 30 hours ago), /recent/webstats/ = 2023-03-27 13:41 (6 30 hours ago)

1 0

** PROBLEM Service Alert: global/collector is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 27 Mar '23

27 Mar '23

***** Icinga ***** Notification Type: PROBLEM Service: collector Host: global Address: global State: WARNING Date/Time: Mon Mar 27 19:22:26 UTC 2023 Additional Info: WARNING: Got a valid response from https://collector.torproject.org/index/index.json with at least one timestamp being outdated: /recent/exit-lists/ = 2023-03-27 16:02 (3 = 3 hours ago)

1 0

Cron <tordnsel@check-01> /srv/tordnsel.torproject.org/monitoring/data/check
by root＠check-01.torproject.org 27 Mar '23

27 Mar '23

date: /srv/tordnsel.torproject.org/lists/latest: No such file or directory /srv/tordnsel.torproject.org/monitoring/bin/data/filestat: line 5: 1679943302 - : syntax error: operand expected (error token is "- ")

1 0

Cron <tordnsel@check-01> /srv/tordnsel.torproject.org/monitoring/data/check
by root＠check-01.torproject.org 27 Mar '23

27 Mar '23

date: /srv/tordnsel.torproject.org/lists/latest: No such file or directory /srv/tordnsel.torproject.org/monitoring/bin/data/filestat: line 5: 1679943001 - : syntax error: operand expected (error token is "- ")

1 0

Cron <onionoo@onionoo-backend-02> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-02.torproject.org 27 Mar '23

27 Mar '23

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 29, in <module> bandwidth = json.loads(requests.get("https://onionoo.torproject.org/bandwidth").text) File "/usr/lib/python3.9/json/__init__.py", line 346, in loads return _default_decoder.decode(s) File "/usr/lib/python3.9/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.9/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

1 0