- metrics-alerts - lists.torproject.org

[FIRING:2] Onionperf disk space -- node
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 2 ## Firing Alerts ----- Time: 2025-06-15 20:27:12.544 +0000 UTC Summary: op-de8a-conflux.onionperf.torproject.net:9100 is using 95.03039170805962% of disk space available. Description: op-de8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-de8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-de8a-conflux.onionperf.torproject.net:9100 disk is almost full. ----- ----- Time: 2025-06-15 13:29:27.544 +0000 UTC Summary: op-hk8a-conflux.onionperf.torproject.net:9100 is using 96.23658471555906% of disk space available. Description: op-hk8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-hk8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-hk8a-conflux.onionperf.torproject.net:9100 disk is almost full. -----

1 0

[FIRING:1] HTTPSResponseDelayExceeded -- blackbox
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-15 18:30:10.651 +0000 UTC Summary: Website http://metrics.torproject.org/ is too slow. Description: Website http://metrics.torproject.org/ has been too slow to respond in the last hour, not achieving our availbility target (95%) in response times (1s), instead having a 1.324s response time. playbook: TODO -----

1 0

[FIRING:1] JobDown -- metrics_web_data
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-15 18:30:06.784 +0000 UTC Summary: Exporter job "metrics_web_data" on metrics.torproject.org:443 is down Description: Exporter job "metrics_web_data" on metrics.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

1 0

[FIRING:1] JobDown -- metrics_web_service
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-15 18:30:06.784 +0000 UTC Summary: Exporter job "metrics_web_service" on metrics.torproject.org:443 is down Description: Exporter job "metrics_web_service" on metrics.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

1 0

[FIRING:1] Onionperf disk space -- node
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-15 13:29:27.544 +0000 UTC Summary: op-hk8a-conflux.onionperf.torproject.net:9100 is using 95.01598922943387% of disk space available. Description: op-hk8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-hk8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-hk8a-conflux.onionperf.torproject.net:9100 disk is almost full. -----

1 0

[FIRING:1] Relays per contact string MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-15 13:14:57.544 +0000 UTC Summary: More than 10 relays have joined the network with the contact string email:tech[]emeraldonion.org url:https://emeraldonion.org proof:uri-rsa abuse:tech[]emeraldonion.org mastodon:https://disobey.net/@emeraldonion cost:460USD uplinkbw:10000 memory:16000 virtualization:kvm zec:t1JShsaJADLKHkcK8Yv9tTE1zPUiQJ4DoQr donationurl:https://emeraldonion.org/donate offlinemasterkey:y signingkeylifetime:30 ciissversion:2 trafficacct:unmetered Description: More than 10 relays have joined the network with the contact string email:tech[]emeraldonion.org url:https://emeraldonion.org proof:uri-rsa abuse:tech[]emeraldonion.org mastodon:https://disobey.net/@emeraldonion cost:460USD uplinkbw:10000 memory:16000 virtualization:kvm zec:t1JShsaJADLKHkcK8Yv9tTE1zPUiQJ4DoQr donationurl:https://emeraldonion.org/donate offlinemasterkey:y signingkeylifetime:30 ciissversion:2 trafficacct:unmetered in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same contact string. -----

1 0

[FIRING:1] Relays per country MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-15 13:14:57.544 +0000 UTC Summary: More than 50 relays have joined the network from us Description: More than 50 relays from us have joined the network in the last 24 hours. playbook: TODO title: Too many relays have joined the network from the same country in the last 24 hours -----

1 0

[FIRING:7] Collector Index Stale -- collector
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 7 ## Firing Alerts ----- Time: 2025-05-29 13:25:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-05-29 13:25:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-05-29 13:25:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-05-29 13:25:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-05-29 13:25:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-05-29 13:25:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-05-29 13:25:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale -----

1 0

[FIRING:1] Relays per Flag MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-15 09:12:57.544 +0000 UTC Summary: More than 50 relays have joined the network with HSDir flag Description: More than 50 relays with HSDir flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours -----

1 0

[FIRING:1] PackagesPendingTooLong
by alertmanager＠prometheus2.torproject.org 15 Jun '25

15 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-15 03:24:36.784 +0000 UTC Summary: Packages pending on Onionperf for a week Description: There are 6 pending package upgrades on Onionperf that have not been automatically installed in a week. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/upgrades#blocked-u… -----

1 0