- metrics-alerts - lists.torproject.org

consensus-microdesc missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 04 Nov '26

04 Nov '26

Consensus of type microdesc with (double) checksum db07fbba8feb8a487bebbc6b24209d13d494b3604e04c8cf176d5cf578cfefc5 submitted to translog seasalp by dirauth key maatuska-microdesc not found in archive collector.tpo Found in translog at 2026-11-04T12:55Z Expected in archive no later than 2026-11-04T16:55Z

1 0

JobDown affecting 6 targets
by alertmanager＠prometheus2.torproject.org 04 Nov '26

04 Nov '26

Total firing alerts: 6 ## Firing Alerts ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Exporter job "onionperf_metrics_port" on op-de8a-conflux.onionperf.torproject.net:9143 is down Description: Exporter job "onionperf_metrics_port" on op-de8a-conflux.onionperf.torproject.net:9143 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Exporter job "onionperf_metrics_port" on op-de8a.onionperf.torproject.net:9143 is down Description: Exporter job "onionperf_metrics_port" on op-de8a.onionperf.torproject.net:9143 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Exporter job "onionperf_metrics_port" on op-hk8a-conflux.onionperf.torproject.net:9143 is down Description: Exporter job "onionperf_metrics_port" on op-hk8a-conflux.onionperf.torproject.net:9143 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Exporter job "onionperf_metrics_port" on op-hk8a.onionperf.torproject.net:9143 is down Description: Exporter job "onionperf_metrics_port" on op-hk8a.onionperf.torproject.net:9143 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Exporter job "onionperf_metrics_port" on op-us8a-conflux.onionperf.torproject.net:9143 is down Description: Exporter job "onionperf_metrics_port" on op-us8a-conflux.onionperf.torproject.net:9143 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Exporter job "onionperf_metrics_port" on op-us8a.onionperf.torproject.net:9143 is down Description: Exporter job "onionperf_metrics_port" on op-us8a.onionperf.torproject.net:9143 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

1 0

JobDown Exporter job "collector" on collector2.torproject.org:443 is down
by alertmanager＠prometheus2.torproject.org 04 Nov '26

04 Nov '26

Total firing alerts: 1 ## Firing Alerts ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Exporter job "collector" on collector2.torproject.org:443 is down Description: Exporter job "collector" on collector2.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

1 0

HostDown Host Onionperf is not responding
by alertmanager＠prometheus2.torproject.org 04 Nov '26

04 Nov '26

Total firing alerts: 6 ## Firing Alerts ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Host Onionperf is not responding Description: The host Onionperf has stopped responding for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Host Onionperf is not responding Description: The host Onionperf has stopped responding for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Host Onionperf is not responding Description: The host Onionperf has stopped responding for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Host Onionperf is not responding Description: The host Onionperf has stopped responding for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Host Onionperf is not responding Description: The host Onionperf has stopped responding for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… ----- ----- Time: 2026-11-04 15:27:51.784 +0000 UTC Summary: Host Onionperf is not responding Description: The host Onionperf has stopped responding for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… -----

1 0

Collector Index Stale Collector index stale for more than 10 minutes
by alertmanager＠prometheus2.torproject.org 04 Nov '26

04 Nov '26

Total firing alerts: 7 ## Firing Alerts ----- Time: 2026-11-04 15:22:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-11-04 15:22:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-11-04 15:22:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-11-04 15:22:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-11-04 15:22:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-11-04 15:22:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2026-11-04 15:22:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale -----

1 0

Relays per Flag MEDIUM affecting 3 targets
by alertmanager＠prometheus2.torproject.org 04 Nov '26

04 Nov '26

Total firing alerts: 3 ## Firing Alerts ----- Time: 2026-11-04 15:21:27.544 +0000 UTC Summary: More than 50 relays have joined the network with Fast flag Description: More than 50 relays with Fast flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours ----- ----- Time: 2026-11-04 15:21:27.544 +0000 UTC Summary: More than 50 relays have joined the network with Guard flag Description: More than 50 relays with Guard flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours ----- ----- Time: 2026-11-04 15:21:27.544 +0000 UTC Summary: More than 50 relays have joined the network with HSDir flag Description: More than 50 relays with HSDir flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours -----

1 0

Onionperf client down affecting 6 targets
by alertmanager＠prometheus2.torproject.org 04 Nov '26

04 Nov '26

Total firing alerts: 6 ## Firing Alerts ----- Time: 2026-11-04 15:17:42.544 +0000 UTC Summary: op-de8a-conflux.onionperf.torproject.net:9100 is currently down. Description: op-de8a-conflux.onionperf.torproject.net:9100 client not responding host: op-de8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-de8a-conflux.onionperf.torproject.net:9100 is down ----- ----- Time: 2026-11-04 15:17:42.544 +0000 UTC Summary: op-de8a.onionperf.torproject.net:9100 is currently down. Description: op-de8a.onionperf.torproject.net:9100 client not responding host: op-de8a.onionperf.torproject.net:9100 playbook: TODO title: op-de8a.onionperf.torproject.net:9100 is down ----- ----- Time: 2026-11-04 15:17:42.544 +0000 UTC Summary: op-hk8a-conflux.onionperf.torproject.net:9100 is currently down. Description: op-hk8a-conflux.onionperf.torproject.net:9100 client not responding host: op-hk8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-hk8a-conflux.onionperf.torproject.net:9100 is down ----- ----- Time: 2026-11-04 15:17:42.544 +0000 UTC Summary: op-hk8a.onionperf.torproject.net:9100 is currently down. Description: op-hk8a.onionperf.torproject.net:9100 client not responding host: op-hk8a.onionperf.torproject.net:9100 playbook: TODO title: op-hk8a.onionperf.torproject.net:9100 is down ----- ----- Time: 2026-11-04 15:17:42.544 +0000 UTC Summary: op-us8a-conflux.onionperf.torproject.net:9100 is currently down. Description: op-us8a-conflux.onionperf.torproject.net:9100 client not responding host: op-us8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-us8a-conflux.onionperf.torproject.net:9100 is down ----- ----- Time: 2026-11-04 15:17:42.544 +0000 UTC Summary: op-us8a.onionperf.torproject.net:9100 is currently down. Description: op-us8a.onionperf.torproject.net:9100 client not responding host: op-us8a.onionperf.torproject.net:9100 playbook: TODO title: op-us8a.onionperf.torproject.net:9100 is down -----

1 0

Relays per Flag MEDIUM affecting 3 targets
by alertmanager＠prometheus2.torproject.org 04 Nov '26

04 Nov '26

Total firing alerts: 3 ## Firing Alerts ----- Time: 2026-11-04 11:19:27.544 +0000 UTC Summary: More than 50 relays have joined the network with Guard flag Description: More than 50 relays with Guard flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours ----- ----- Time: 2026-11-04 10:13:27.544 +0000 UTC Summary: More than 50 relays have joined the network with HSDir flag Description: More than 50 relays with HSDir flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours ----- ----- Time: 2026-11-04 11:19:27.544 +0000 UTC Summary: More than 50 relays have joined the network with Stable flag Description: More than 50 relays with Stable flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours -----

1 0

consensus-microdesc missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 04 Nov '26

04 Nov '26

Consensus of type microdesc with (double) checksum 814ece53ffe744b47ca3a1a2af89455d7d958ab7d11bc85bf6bc6719dc335b1f submitted to translog seasalp by dirauth key maatuska-microdesc not found in archive collector.tpo Found in translog at 2026-11-04T07:56Z Expected in archive no later than 2026-11-04T11:56Z

1 0

consensus-ns missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 04 Nov '26

04 Nov '26

Consensus of type ns with (double) checksum 605b4b8f358bbaee35c0fc2543410a6d32bf860fa6cb3ee17365705213ca8acc submitted to translog seasalp by dirauth key maatuska-ns not found in archive collector.tpo Found in translog at 2026-11-04T07:56Z Expected in archive no later than 2026-11-04T11:56Z

1 0