- metrics-alerts - lists.torproject.org

[FIRING:6] SystemdFailedUnits -- node
by alertmanager＠prometheus2.torproject.org 17 Jun '25

17 Jun '25

Total firing alerts: 6 ## Firing Alerts ----- Time: 2025-06-05 21:26:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-05-23 06:30:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-06-13 00:46:36.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-05-23 06:30:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-05-23 06:30:06.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… ----- ----- Time: 2025-05-24 03:33:51.784 +0000 UTC Summary: Some systemd units are in failed state on Onionperf Description: There are currently 1 units in a failed state on Onionperf playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/puppet#failed-syst… -----

1 0

[FIRING:1] HTTPSResponseDelayExceeded -- blackbox
by alertmanager＠prometheus2.torproject.org 17 Jun '25

17 Jun '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-06-17 20:30:10.651 +0000 UTC Summary: Website http://onionoo.torproject.org/ is too slow. Description: Website http://onionoo.torproject.org/ has been too slow to respond in the last hour, not achieving our availbility target (95%) in response times (1s), instead having a 1.138s response time. playbook: TODO -----

1 0

[FIRING:2] Onionperf disk space -- node
by alertmanager＠prometheus2.torproject.org 17 Jun '25

17 Jun '25

Total firing alerts: 2 ## Firing Alerts ----- Time: 2025-06-17 19:20:12.544 +0000 UTC Summary: op-de8a-conflux.onionperf.torproject.net:9100 is using 95.0200660444025% of disk space available. Description: op-de8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-de8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-de8a-conflux.onionperf.torproject.net:9100 disk is almost full. ----- ----- Time: 2025-06-17 11:40:27.544 +0000 UTC Summary: op-hk8a-conflux.onionperf.torproject.net:9100 is using 96.25288711629773% of disk space available. Description: op-hk8a-conflux.onionperf.torproject.net:9100 disk space used is more than 95% host: op-hk8a-conflux.onionperf.torproject.net:9100 playbook: TODO title: op-hk8a-conflux.onionperf.torproject.net:9100 disk is almost full. -----

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 17 Jun '25

17 Jun '25

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 143, in <module> test_onionoo(host) ~~~~~~~~~~~~^^^^^^ File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 76, in test_onionoo relays_ts = datetime.datetime.strptime(relays_str, ISO_DATETIME) ^^^^^^^^^^^^^^^^^ AttributeError: type object 'datetime.datetime' has no attribute 'datetime'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 17 Jun '25

17 Jun '25

/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo:84: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC). utcnow = datetime.datetime.utcnow()

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 17 Jun '25

17 Jun '25

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 165, in <module> if total_overload_general_relays_version[version]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ KeyError: '0_4_8_11'

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 17 Jun '25

17 Jun '25

/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo:84: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC). utcnow = datetime.datetime.utcnow()

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 17 Jun '25

17 Jun '25

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 162, in <module> if __check_time_delta(relay, 'overload_general_timestamp', 19): ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 20, in __check_time_delta if (now - timestamp) < timedelta(hours=interval): ~~~~^~~~~~~~~~~ TypeError: can't subtract offset-naive and offset-aware datetimes

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 17 Jun '25

17 Jun '25

/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo:84: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC). utcnow = datetime.datetime.utcnow()

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 17 Jun '25

17 Jun '25

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 162, in <module> if __check_time_delta(relay, 'overload_general_timestamp', 19): ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 20, in __check_time_delta if (now - timestamp) < timedelta(hours=interval): ~~~~^~~~~~~~~~~ TypeError: can't subtract offset-naive and offset-aware datetimes

1 0