- metrics-alerts - lists.torproject.org

[FIRING:1] Relays per Flag MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 09 May '26

09 May '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-05-08 23:15:12.544 +0000 UTC Summary: More than 50 relays have joined the network with Stable flag Description: More than 50 relays with Stable flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours -----

1 0

[FIRING:1] Onionperf disk space -- node
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-05-08 22:30:12.544 +0000 UTC Summary: op-de8a-conflux.onionperf.torproject.net:9100 is using 95.00596174826008% of disk space available. Description: op-de8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-de8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-de8a-conflux.onionperf.torproject.net:9100 disk is almost full. -----

1 0

[FIRING:12] Collector Index Stale -- collector
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 12 ## Firing Alerts ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:40:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/bridge-descriptors/extra-infos/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:40:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/bridge-descriptors/server-descriptors/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale -----

1 0

[FIRING:7] Collector Index Stale -- collector
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 7 ## Firing Alerts ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale -----

1 0

Cron <collector@collector-02> /srv/collector.torproject.org/collector/monitoring/services/collector
by root＠collector-02.torproject.org 08 May '26

08 May '26

Error fetching or parsing index from collector.torproject.org: <urlopen error [Errno 111] Connection refused> Could not fetch or parse index.json from collector.torproject.org

1 0

Cron <collector@collector-02> /srv/collector.torproject.org/collector/monitoring/services/collector
by root＠collector-02.torproject.org 08 May '26

08 May '26

Error fetching or parsing index from collector.torproject.org: <urlopen error [Errno -3] Temporary failure in name resolution> Could not fetch or parse index.json from collector.torproject.org Error fetching or parsing index from collector2.torproject.org: <urlopen error [Errno -3] Temporary failure in name resolution> Could not fetch or parse index.json from collector2.torproject.org

1 0

[FIRING:1] PackagesPendingTooLong
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-05-08 16:53:03.867 +0000 UTC Summary: Packages pending on Onionperf for a week Description: There are 1 pending package upgrades on Onionperf that have not been automatically installed for two days. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/upgrades#blocked-u… -----

1 0

[FIRING:16] Collector Index Stale -- collector
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 16 ## Firing Alerts ----- Time: 2026-05-03 21:56:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-03 21:56:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-03 21:56:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-03 21:56:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-03 21:56:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-03 21:56:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-03 21:56:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 03:45:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/bridge-descriptors/extra-infos/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 13:05:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/bridge-descriptors/server-descriptors/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-04 06:45:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-04 06:40:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-04 06:45:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-04 06:40:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-04 06:40:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-04 06:45:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-04 06:40:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale -----

1 0

[FIRING:1] Relays per contact string MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-05-08 07:15:27.544 +0000 UTC Summary: More than 10 relays have joined the network with the contact string jsrel(a)gmail.com Description: More than 10 relays have joined the network with the contact string jsrel(a)gmail.com in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same contact string. -----

1 0

[FIRING:1] Relays per contact string MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-05-08 05:20:27.544 +0000 UTC Summary: More than 10 relays have joined the network with the contact string None Description: More than 10 relays have joined the network with the contact string None in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same contact string. -----

1 0