September 2025 - anti-censorship-alerts

[FIRING:1] ignoring bridges by functionality -- metrics-standard
by alertmanager＠prometheus2.torproject.org 01 Oct '25

01 Oct '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-09-30 21:07:14.934 +0000 UTC Summary: rdsys is ignoring the restuls from bridgestrap, as less than half of the bridges are functional. This happens sometimes when rdsys is being restarted but if persist there is a problem on bridgestrap. Description: The fraction of functional bridges is too low for rdsys playbook: https://gitlab.torproject.org/tpo/anti-censorship/team/-/wikis/Survival-Gui… title: rdsys is ignoring the functionality of bridges -----

1 0

[FIRING:1] gettor silence
by alertmanager＠prometheus2.torproject.org 28 Sep '25

28 Sep '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-09-28 06:05:29.934 +0000 UTC Summary: There might be a problem with the email delivery. Description: No email has arrived to gettor for the last 12 hours playbook: https://gitlab.torproject.org/tpo/anti-censorship/team/-/wikis/Survival-Gui… title: gettor is silent -----

1 0

[FIRING:2] X509CertNearExpired -- blackbox
by alertmanager＠prometheus2.torproject.org 26 Sep '25

26 Sep '25

Total firing alerts: 2 ## Firing Alerts ----- Time: 2025-09-23 18:59:10.651 +0000 UTC Summary: TLS certificate for https://1098762253.rsc.cdn77.org/debug is nearing expiry date Description: Certificate expiry date for https://1098762253.rsc.cdn77.org/debug is less than 28 days. It will expire in 19d 5h 6m 55s. playbook: TODO ----- ----- Time: 2025-09-26 00:42:40.651 +0000 UTC Summary: TLS certificate for https://snowflake.torproject.org is nearing expiry date Description: Certificate expiry date for https://snowflake.torproject.org is less than 28 days. It will expire in 27d 23h 58m 43s. playbook: TODO -----

1 0

[FIRING:5] JobDown -- metrics-standard
by alertmanager＠prometheus2.torproject.org 25 Sep '25

25 Sep '25

Total firing alerts: 5 ## Firing Alerts ----- Time: 2025-09-25 15:40:51.784 +0000 UTC Summary: Exporter job "metrics-standard" on bridges-email.torproject.org:443 is down Description: Exporter job "metrics-standard" on bridges-email.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2025-09-25 15:51:06.784 +0000 UTC Summary: Exporter job "metrics-standard" on bridges.torproject.org:443 is down Description: Exporter job "metrics-standard" on bridges.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2025-09-25 15:52:06.784 +0000 UTC Summary: Exporter job "metrics-standard" on rdsys-backend.torproject.org:443 is down Description: Exporter job "metrics-standard" on rdsys-backend.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2025-09-25 15:40:21.784 +0000 UTC Summary: Exporter job "metrics-standard" on rdsys-gettor.torproject.org:443 is down Description: Exporter job "metrics-standard" on rdsys-gettor.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… ----- ----- Time: 2025-09-25 15:55:36.784 +0000 UTC Summary: Exporter job "metrics-standard" on rdsys-moat.torproject.org:443 is down Description: Exporter job "metrics-standard" on rdsys-moat.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

1 0

[FIRING:1] JobDown -- bridges
by alertmanager＠prometheus2.torproject.org 25 Sep '25

25 Sep '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-09-25 15:52:06.784 +0000 UTC Summary: Exporter job "bridges" on bridges.torproject.org:443 is down Description: Exporter job "bridges" on bridges.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

1 0

[FIRING:1] JobDown -- rdsys-telegram
by alertmanager＠prometheus2.torproject.org 25 Sep '25

25 Sep '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-09-25 15:51:51.784 +0000 UTC Summary: Exporter job "rdsys-telegram" on bridges.torproject.org:443 is down Description: Exporter job "rdsys-telegram" on bridges.torproject.org:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

1 0

[FIRING:1] JobDown -- snowflake-broker
by alertmanager＠prometheus2.torproject.org 25 Sep '25

25 Sep '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-09-25 15:45:06.784 +0000 UTC Summary: Exporter job "snowflake-broker" on snowflake-broker.torproject.net:443 is down Description: Exporter job "snowflake-broker" on snowflake-broker.torproject.net:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

1 0

[FIRING:1] Snowflake drop of client polls
by alertmanager＠prometheus2.torproject.org 24 Sep '25

24 Sep '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-09-24 06:56:15.286 +0000 UTC Summary: There is a considerable drop on snowflake client polls Description: This might mean a problem in our signaling channels, or some other thing blocking clients to reach the broker playbook: https://gitlab.torproject.org/tpo/anti-censorship/team/-/issues/161 title: Snowflake drop of client polls -----

1 0

[FIRING:1] number of bridges is not changing in rdsys
by alertmanager＠prometheus2.torproject.org 23 Sep '25

23 Sep '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-09-22 19:07:14.934 +0000 UTC Summary: Last time this happen there was an issue on the communication between rdsys and bridgestrap rdsys#249 Description: For the last 3h we have the same number of bridges in rdsys, this usually fluctuates playbook: https://gitlab.torproject.org/tpo/anti-censorship/team/-/wikis/Survival-Gui… title: number of bridges is not changing in rdsys -----

2 1

[FIRING:1] JobDown -- snowflake-broker
by alertmanager＠prometheus2.torproject.org 22 Sep '25

22 Sep '25

Total firing alerts: 1 ## Firing Alerts ----- Time: 2025-09-20 19:55:06.784 +0000 UTC Summary: Exporter job "snowflake-broker" on snowflake-broker.torproject.net:443 is down Description: Exporter job "snowflake-broker" on snowflake-broker.torproject.net:443 has been unreachable for more than 15 minutes. playbook: https://gitlab.torproject.org/tpo/tpa/team/-/wikis/service/prometheus#expor… -----

2 1