- metrics-alerts - lists.torproject.org

consensus-microdesc missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 09 May '26

09 May '26

Consensus of type microdesc with (double) checksum fe7b6b36253d85a237bf8cb84db000200fa6547ea42d2b08d89e3fed2f77d1a5 submitted to translog seasalp by dirauth key gabelmoo-microdesc not found in archive collector.tpo Found in translog at 2026-05-08T22:56Z Expected in archive no later than 2026-05-09T02:56Z

1 0

consensus-microdesc missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 09 May '26

09 May '26

Consensus of type microdesc with (double) checksum fe7b6b36253d85a237bf8cb84db000200fa6547ea42d2b08d89e3fed2f77d1a5 submitted to translog seasalp by dirauth key maatuska-microdesc not found in archive collector.tpo Found in translog at 2026-05-08T22:56Z Expected in archive no later than 2026-05-09T02:56Z

1 0

consensus-ns missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 09 May '26

09 May '26

Consensus of type ns with (double) checksum 869627e2c667bd2e4f30d80086a3199e6b55ddbeca8b567a8a864ccf7f6eb740 submitted to translog seasalp by dirauth key gabelmoo-ns not found in archive collector.tpo Found in translog at 2026-05-08T22:56Z Expected in archive no later than 2026-05-09T02:56Z

1 0

[FIRING:1] Relays per Flag MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-05-08 23:15:12.544 +0000 UTC Summary: More than 50 relays have joined the network with Stable flag Description: More than 50 relays with Stable flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours -----

1 0

[FIRING:1] Onionperf disk space -- node
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-05-08 22:30:12.544 +0000 UTC Summary: op-de8a-conflux.onionperf.torproject.net:9100 is using 95.00596174826008% of disk space available. Description: op-de8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-de8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-de8a-conflux.onionperf.torproject.net:9100 disk is almost full. -----

1 0

[FIRING:12] Collector Index Stale -- collector
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 12 ## Firing Alerts ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:37:27.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:40:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/bridge-descriptors/extra-infos/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:40:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/bridge-descriptors/server-descriptors/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale -----

1 0

[FIRING:7] Collector Index Stale -- collector
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 7 ## Firing Alerts ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-05-08 17:30:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector2.torproject.org:443 playbook: TODO title: Collector Index Stale -----

1 0

Cron <collector@collector-02> /srv/collector.torproject.org/collector/monitoring/services/collector
by root＠collector-02.torproject.org 08 May '26

08 May '26

Error fetching or parsing index from collector.torproject.org: <urlopen error [Errno 111] Connection refused> Could not fetch or parse index.json from collector.torproject.org

1 0

Cron <collector@collector-02> /srv/collector.torproject.org/collector/monitoring/services/collector
by root＠collector-02.torproject.org 08 May '26

08 May '26

Error fetching or parsing index from collector.torproject.org: <urlopen error [Errno -3] Temporary failure in name resolution> Could not fetch or parse index.json from collector.torproject.org Error fetching or parsing index from collector2.torproject.org: <urlopen error [Errno -3] Temporary failure in name resolution> Could not fetch or parse index.json from collector2.torproject.org

1 0

[FIRING:1] PackagesPendingTooLong
by alertmanager＠prometheus2.torproject.org 08 May '26

08 May '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-05-08 16:53:03.867 +0000 UTC Summary: Packages pending on Onionperf for a week Description: There are 1 pending package upgrades on Onionperf that have not been automatically installed for two days. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/upgrades#blocked-u… -----

1 0