- metrics-alerts - lists.torproject.org

[FIRING:2] DiskWillFillSoon -- node
by alertmanager＠prometheus2.torproject.org 23 Jun '25

23 Jun '25

Total firing alerts: 2 ## Firing Alerts ----- Time: 2025-06-23 00:28:06.784 +0000 UTC Summary: Disk / on Onionperf is almost full Description: Disk / on Onionperf will be full in less than 24 hours dashboard: https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?from=now-7d&to=now&va… playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… ----- ----- Time: 2025-06-22 23:30:36.784 +0000 UTC Summary: Disk / on Onionperf is almost full Description: Disk / on Onionperf will be full in less than 24 hours dashboard: https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?from=now-7d&to=now&va… playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… -----

1 0

[FIRING:1] DiskWillFillSoon -- node
by alertmanager＠prometheus2.torproject.org 23 Jun '25

23 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-22 23:30:36.784 +0000 UTC Summary: Disk / on Onionperf is almost full Description: Disk / on Onionperf will be full in less than 24 hours dashboard: https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?from=now-7d&to=now&va… playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/incident-response#… -----

1 0

[FIRING:6] SystemdFailedUnits -- node
by alertmanager＠prometheus2.torproject.org 23 Jun '25

23 Jun '25

Total firing alerts: 6 ## Firing Alerts ----- Time: 2025-06-19 18:16:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-06-19 18:16:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-06-19 18:16:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-06-19 18:16:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-06-20 01:41:21.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-06-19 18:16:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… -----

1 0

[FIRING:2] Onionperf disk space -- node
by alertmanager＠prometheus2.torproject.org 22 Jun '25

22 Jun '25

Total firing alerts: 2 ## Firing Alerts ----- Time: 2025-06-22 14:48:12.544 +0000 UTC Summary: op-de8a-conflux.onionperf.torproject.net:9100 is using 95.02395335307341% of disk space available. Description: op-de8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-de8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-de8a-conflux.onionperf.torproject.net:9100 disk is almost full. ----- ----- Time: 2025-06-22 07:04:27.544 +0000 UTC Summary: op-hk8a-conflux.onionperf.torproject.net:9100 is using 96.41686351430877% of disk space available. Description: op-hk8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-hk8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-hk8a-conflux.onionperf.torproject.net:9100 disk is almost full. -----

1 0

[FIRING:1] Relays per AS MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 22 Jun '25

22 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-22 10:13:57.544 +0000 UTC Summary: More than 50 relays have joined the network from AS36849 Description: More than 50 relays from AS36849 have joined the network in the last 24 hours. playbook: TODO title: Too many relays have joined the network from the same AS in the last 24 hours -----

1 0

[FIRING:7] Collector Index Stale -- collector
by alertmanager＠prometheus2.torproject.org 22 Jun '25

22 Jun '25

Total firing alerts: 7 ## Firing Alerts ----- Time: 2025-06-21 19:34:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/bandwidths/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-06-21 19:34:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/consensuses/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-06-21 19:34:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/extra-infos/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-06-21 19:34:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/consensus-microdesc/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-06-21 19:34:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/microdescs/micro/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-06-21 19:34:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/server-descriptors/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale ----- ----- Time: 2025-06-21 19:34:42.544 +0000 UTC Summary: Collector index stale for more than 10 minutes Description: The collector index freshness metric has been in a critical state for more than 10 minutes for /recent/relay-descriptors/votes/ on host: collector.torproject.org:443 playbook: TODO title: Collector Index Stale -----

1 0

[FIRING:2] Relays per Flag MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 22 Jun '25

22 Jun '25

Total firing alerts: 2 ## Firing Alerts ----- Time: 2025-06-22 09:18:57.544 +0000 UTC Summary: More than 50 relays have joined the network with Running flag Description: More than 50 relays with Running flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours ----- ----- Time: 2025-06-22 09:18:57.544 +0000 UTC Summary: More than 50 relays have joined the network with Valid flag Description: More than 50 relays with Valid flag have joined the network in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same flag in the last 2 hours -----

1 0

[FIRING:1] Relays per nickname prefix MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 22 Jun '25

22 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-22 09:18:57.544 +0000 UTC Summary: More than 10 relays have joined the network with the nickname prefix testr Description: More than 10 relays have joined the network with the nickname prefix testr in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same nickname prefix in the last 2 hours -----

1 0

[FIRING:2] Relays per contact string MEDIUM -- onionoo_network
by alertmanager＠prometheus2.torproject.org 22 Jun '25

22 Jun '25

Total firing alerts: 2 ## Firing Alerts ----- Time: 2025-06-22 09:18:57.544 +0000 UTC Summary: More than 10 relays have joined the network with the contact string email:tor[]1aeo.com url:https://www.1aeo.com proof:uri-rsa abuse:abuse[]1aeo.com ciissversion:2 Description: More than 10 relays have joined the network with the contact string email:tor[]1aeo.com url:https://www.1aeo.com proof:uri-rsa abuse:abuse[]1aeo.com ciissversion:2 in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same contact string. ----- ----- Time: 2025-06-22 09:18:57.544 +0000 UTC Summary: More than 10 relays have joined the network with the contact string email:tor[]r0cket.net url:https://tor.r0cket.net/ proof:uri-rsa abuse:abuse[]r0cket.net hoster:r0cket.cloud uplinkbw:10000 memory:32768 cpu:16 virtualization:kvm donationurl:https://tor.r0cket.net/ offlinemasterkey:n sandbox:y os:ubuntu/24.04 tls:openssl aesni:y autoupdate:y confmgmt:terraform dnslocation:sameas dnsqname:y dnssec:y ciissversion:2 trafficacct:unmetered Description: More than 10 relays have joined the network with the contact string email:tor[]r0cket.net url:https://tor.r0cket.net/ proof:uri-rsa abuse:abuse[]r0cket.net hoster:r0cket.cloud uplinkbw:10000 memory:32768 cpu:16 virtualization:kvm donationurl:https://tor.r0cket.net/ offlinemasterkey:n sandbox:y os:ubuntu/24.04 tls:openssl aesni:y autoupdate:y confmgmt:terraform dnslocation:sameas dnsqname:y dnssec:y ciissversion:2 trafficacct:unmetered in the last 2 hours. playbook: TODO title: Too many relays have joined the network with the same contact string. -----

1 0

[FIRING:1] Onionperf disk space -- node
by alertmanager＠prometheus2.torproject.org 22 Jun '25

22 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-22 07:04:27.544 +0000 UTC Summary: op-hk8a-conflux.onionperf.torproject.net:9100 is using 95.01963358131285% of disk space available. Description: op-hk8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-hk8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-hk8a-conflux.onionperf.torproject.net:9100 disk is almost full. -----

1 0