metrics-alerts

Thread Start a new thread

metrics-alerts@lists.torproject.org

3 participants
20981 discussions

consensus-microdesc missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 07 Apr '26

07 Apr '26

Consensus of type microdesc with (double) checksum 640f6d1f26a94b716866ee70ad3d2bdae2085fb3a8c066174afcc68a111ee9c4 submitted to translog seasalp by dirauth key maatuska-microdesc not found in archive collector.tpo Found in translog at 2026-04-06T20:56Z Expected in archive no later than 2026-04-07T00:56Z

1 0

[FIRING:2] Onionoo Data Freshness -- onionoo_service
by alertmanager＠prometheus2.torproject.org 06 Apr '26

06 Apr '26

Total firing alerts: 2 ## Firing Alerts ----- Time: 2026-04-06 12:45:42.544 +0000 UTC Summary: Onionoo data has not been updated for the past 4h or more Description: Onionoo data has not been updated for the past 4h host: onionoo.torproject.org:443 playbook: TODO title: Onionoo Data Freshness ----- ----- Time: 2026-04-06 12:45:42.544 +0000 UTC Summary: Onionoo data has not been updated for the past 4h or more Description: Onionoo data has not been updated for the past 4h host: onionoo.torproject.org:443 playbook: TODO title: Onionoo Data Freshness -----

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Error processing log file: [Errno 2] No such file or directory: '/srv/onionoo.torproject.org/onionoo/logs/metrics.log'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Error processing log file: [Errno 2] No such file or directory: '/srv/onionoo.torproject.org/onionoo/logs/metrics.log'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Error processing log file: [Errno 2] No such file or directory: '/srv/onionoo.torproject.org/onionoo/logs/metrics.log'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Error processing log file: [Errno 2] No such file or directory: '/srv/onionoo.torproject.org/onionoo/logs/metrics.log'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Error processing log file: [Errno 2] No such file or directory: '/srv/onionoo.torproject.org/onionoo/logs/metrics.log'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 371, in write_to_textfile f.write(generate_latest(registry)) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 371, in write_to_textfile f.write(generate_latest(registry)) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Jump to page: