April 2026 - metrics-alerts - lists.torproject.org

[FIRING:2] Onionoo Data Freshness -- onionoo_service
by alertmanager＠prometheus2.torproject.org 07 Apr '26

07 Apr '26

Total firing alerts: 2 ## Firing Alerts ----- Time: 2026-04-07 05:05:42.544 +0000 UTC Summary: Onionoo data has not been updated for the past 4h or more Description: Onionoo data has not been updated for the past 4h host: onionoo.torproject.org:443 playbook: TODO title: Onionoo Data Freshness ----- ----- Time: 2026-04-07 05:05:42.544 +0000 UTC Summary: Onionoo data has not been updated for the past 4h or more Description: Onionoo data has not been updated for the past 4h host: onionoo.torproject.org:443 playbook: TODO title: Onionoo Data Freshness -----

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 371, in write_to_textfile f.write(generate_latest(registry)) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device: '/srv/onionoo.torproject.org/onionoo/network/metrics.1856241.140471390353280'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device: '/srv/onionoo.torproject.org/onionoo/network/metrics.1855967.140211585017728'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device: '/srv/onionoo.torproject.org/onionoo/network/metrics.1855706.140095878608768'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 07 Apr '26

07 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device: '/srv/onionoo.torproject.org/onionoo/network/metrics.1855411.140072019453824'

1 0