- metrics-alerts - lists.torproject.org

Cron <exonerator@materculae> cd /srv/exonerator.torproject.org/exonerator/ && ~exonerator/bin/run-exonerator
by root＠materculae.torproject.org 28 Aug '24

28 Aug '24

2024-08-28 21:22:02,333 ERROR o.t.m.e.ExoneraTorDatabaseImporter:167 Lock file /srv/exonerator.torproject.org/exonerator/exonerator-lock is less than 6 hours old. Either make sure that there are no other ExoneraTor database importers running and manually delete that file, or wait until the file is 6 hours old when it will be overwritten automatically. Exiting.

1 0

Cron <exonerator@materculae> cd /srv/exonerator.torproject.org/exonerator/ && ~exonerator/bin/run-exonerator
by root＠materculae.torproject.org 28 Aug '24

28 Aug '24

2024-08-28 18:22:02,175 ERROR o.t.m.e.ExoneraTorDatabaseImporter:167 Lock file /srv/exonerator.torproject.org/exonerator/exonerator-lock is less than 6 hours old. Either make sure that there are no other ExoneraTor database importers running and manually delete that file, or wait until the file is 6 hours old when it will be overwritten automatically. Exiting.

1 0

Cron <metrics@meronense> /srv/metrics.torproject.org/metrics/monitoring/network/website
by root＠meronense.torproject.org 28 Aug '24

28 Aug '24

Traceback (most recent call last): File "/srv/metrics.torproject.org/metrics/monitoring/network/website", line 66, in <module> write_to_textfile('/srv/metrics.torproject.org/metrics/network/metrics', registry) File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 303, in write_to_textfile with open(tmppath, 'wb') as f: OSError: [Errno 28] No space left on device

1 0

Cron <metrics@meronense> /srv/metrics.torproject.org/metrics/monitoring/data/website
by root＠meronense.torproject.org 28 Aug '24

28 Aug '24

Traceback (most recent call last): File "/srv/metrics.torproject.org/metrics/monitoring/data/website", line 32, in <module> write_to_textfile("/srv/metrics.torproject.org/metrics/data/metrics", registry=registry) File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 303, in write_to_textfile with open(tmppath, 'wb') as f: OSError: [Errno 28] No space left on device

1 0

Cron <metrics@meronense> /srv/metrics.torproject.org/metrics/monitoring/services/website
by root＠meronense.torproject.org 28 Aug '24

28 Aug '24

Traceback (most recent call last): File "/srv/metrics.torproject.org/metrics/monitoring/services/website", line 38, in <module> write_to_textfile("/srv/metrics.torproject.org/metrics/service/metrics", registry=registry) File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 303, in write_to_textfile with open(tmppath, 'wb') as f: OSError: [Errno 28] No space left on device

1 0

[FIRING:6] NeedsReboot
by alertmanager＠hetzner-nbg1-02.torproject.org 28 Aug '24

28 Aug '24

Total firing alerts: 6 Total resolved alerts: 0 ## Firing Alerts ----- Time: 2024-08-22 23:41:02.366 +0000 UTC Summary: Host Onionperf needs to reboot Description: Found pending kernel upgrades for host Onionperf ----- ----- Time: 2024-08-22 23:41:02.366 +0000 UTC Summary: Host Onionperf needs to reboot Description: Found pending kernel upgrades for host Onionperf ----- ----- Time: 2024-08-24 07:14:32.366 +0000 UTC Summary: Host Onionperf needs to reboot Description: Found pending kernel upgrades for host Onionperf ----- ----- Time: 2024-08-22 23:41:02.366 +0000 UTC Summary: Host Onionperf needs to reboot Description: Found pending kernel upgrades for host Onionperf ----- ----- Time: 2024-08-22 23:41:02.366 +0000 UTC Summary: Host Onionperf needs to reboot Description: Found pending kernel upgrades for host Onionperf ----- ----- Time: 2024-08-22 23:41:02.366 +0000 UTC Summary: Host Onionperf needs to reboot Description: Found pending kernel upgrades for host Onionperf ----- ##Resolved Alerts

1 0

Cron <exonerator@materculae> cd /srv/exonerator.torproject.org/exonerator/ && ~exonerator/bin/run-exonerator
by root＠materculae.torproject.org 28 Aug '24

28 Aug '24

2024-08-28 14:22:02,399 ERROR o.t.m.e.ExoneraTorDatabaseImporter:167 Lock file /srv/exonerator.torproject.org/exonerator/exonerator-lock is less than 6 hours old. Either make sure that there are no other ExoneraTor database importers running and manually delete that file, or wait until the file is 6 hours old when it will be overwritten automatically. Exiting.

1 0

Cron <exonerator@materculae> cd /srv/exonerator.torproject.org/exonerator/ && ~exonerator/bin/run-exonerator
by root＠materculae.torproject.org 28 Aug '24

28 Aug '24

2024-08-28 12:22:01,981 ERROR o.t.m.e.ExoneraTorDatabaseImporter:167 Lock file /srv/exonerator.torproject.org/exonerator/exonerator-lock is less than 6 hours old. Either make sure that there are no other ExoneraTor database importers running and manually delete that file, or wait until the file is 6 hours old when it will be overwritten automatically. Exiting.

1 0

Cron <exonerator@materculae> cd /srv/exonerator.torproject.org/exonerator/ && ~exonerator/bin/run-exonerator
by root＠materculae.torproject.org 28 Aug '24

28 Aug '24

2024-08-28 07:22:02,723 ERROR o.t.m.e.ExoneraTorDatabaseImporter:167 Lock file /srv/exonerator.torproject.org/exonerator/exonerator-lock is less than 6 hours old. Either make sure that there are no other ExoneraTor database importers running and manually delete that file, or wait until the file is 6 hours old when it will be overwritten automatically. Exiting.

1 0

Cron <exonerator@materculae> cd /srv/exonerator.torproject.org/exonerator/ && ~exonerator/bin/run-exonerator
by root＠materculae.torproject.org 28 Aug '24

28 Aug '24

2024-08-28 05:22:02,181 ERROR o.t.m.e.ExoneraTorDatabaseImporter:167 Lock file /srv/exonerator.torproject.org/exonerator/exonerator-lock is less than 6 hours old. Either make sure that there are no other ExoneraTor database importers running and manually delete that file, or wait until the file is 6 hours old when it will be overwritten automatically. Exiting.

1 0