- metrics-alerts - lists.torproject.org

monit alert -- Monit instance changed op-nl3
by Monit 23 Jul '20

23 Jul '20

Monit instance changed Service op-nl3 Date: Thu, 23 Jul 2020 08:45:13 Action: start Host: op-nl3 Description: Monit 5.26.0 started

1 0

** RECOVERY Service Alert: global/collector is OK **
by nagios＠hetzner-hel1-01.torproject.org 08 Jul '20

08 Jul '20

***** Icinga ***** Notification Type: RECOVERY Service: collector Host: global Address: global State: OK Date/Time: Wed Jul 8 01:48:52 UTC 2020 Additional Info: OK: Got a valid response from https://collector.torproject.org/index/index.json with recent timestamps: /archive/bridgedb-metrics/ = 2020-07-07 09:53 (15 72 hours ago), /archive/bridge-descriptors/extra-infos/ = 2020-07-07 09:41 (16 72 hours ago), /archive/bridge-descriptors/server-descriptors/ = 2020-07-07 09:25 (16 72 hours ago), /archive/bridge-descriptors/statuses/ = 2020-07-07 09:13 (16 72 hours ago), /archive/bridge-pool-assignments/ = 2020-07-07 09:52 (15 72 hours ago), /archive/exit-lists/ = 2020-07-07 03:25 (22 72 hours ago), /archive/onionperf/ = 2020-07-07 03:26 (22 72 hours ago), /archive/relay-descriptors/ = 2020-07-07 03:27 (22 720 hours ago), /archive/relay-descriptors/bandwidths/ = 2020-07-07 06:48 (19 72 hours ago), /archive/relay-descriptors/consensuses/ = 2020-07-07 03:40 (22 72 hours ago), /archive/relay-descriptors/extra-infos/ = 2020-07-07 08:57 (16 72 hours ago), /archive/relay-descriptors/microdescs/ = 2020-07-07 03:31 (22 72 hours ago), /archive/r elay-descriptors/server-descriptors/ = 2020-07-07 08:27 (17 72 hours ago), /archive/relay-descriptors/votes/ = 2020-07-07 04:35 (21 72 hours ago), /archive/snowflakes/ = 2020-07-07 09:52 (15 72 hours ago), /archive/webstats/ = 2020-07-07 09:54 (15 72 hours ago), /recent/bridgedb-metrics/ = 2020-07-07 21:40 (4 60 hours ago), /recent/bridge-descriptors/extra-infos/ = 2020-07-08 01:09 (0 3 hours ago), /recent/bridge-descriptors/server-descriptors/ = 2020-07-08 01:09 (0 3 hours ago), /recent/bridge-descriptors/statuses/ = 2020-07-08 01:09 (0 3 hours ago), /recent/bridge-pool-assignments/ = 2020-07-08 00:09 (1 30 hours ago), /recent/exit-lists/ = 2020-07-08 01:02 (0 3 hours ago), /recent/onionperf/ = 2020-07-07 02:10 (23 30 hours ago), /recent/relay-descriptors/bandwidths/ = 2020-07-08 01:35 (0 3 hours ago), /recent/relay-descriptors/consensuses/ = 2020-07-08 01:05 (0 3 hours ago), /recent/relay-descriptors/extra-infos/ = 2020-07-08 01:05 (0 3 hours ago), /recent/relay-desc riptors/microdescs/consensus-microdesc/ = 2020-07-08 01:05 (0 3 hours ago), /recent/relay-descriptors/microdescs/micro/ = 2020-07-08 01:05 (0 3 hours ago), /recent/relay-descriptors/server-descriptors/ = 2020-07-08 01:05 (0 3 hours ago), /recent/relay-descriptors/votes/ = 2020-07-08 01:05 (0 3 hours ago), /recent/snowflakes/ = 2020-07-08 01:40 (0 30 hours ago), /recent/webstats/ = 2020-07-07 01:47 (24 30 hours ago)

1 0

** PROBLEM Service Alert: global/collector is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 08 Jul '20

08 Jul '20

***** Icinga ***** Notification Type: PROBLEM Service: collector Host: global Address: global State: WARNING Date/Time: Wed Jul 8 00:03:52 UTC 2020 Additional Info: WARNING: Got a valid response from https://collector.torproject.org/index/index.json with at least one timestamp being outdated: /recent/snowflakes/ = 2020-07-06 17:40 (30 = 30 hours ago)

1 0

** RECOVERY Service Alert: global/collector is OK **
by nagios＠hetzner-hel1-01.torproject.org 01 Jul '20

01 Jul '20

***** Icinga ***** Notification Type: RECOVERY Service: collector Host: global Address: global State: OK Date/Time: Wed Jul 1 04:30:53 UTC 2020 Additional Info: OK: Got a valid response from https://collector.torproject.org/index/index.json with recent timestamps: /archive/bridgedb-metrics/ = 2020-06-29 09:52 (42 72 hours ago), /archive/bridge-descriptors/extra-infos/ = 2020-06-29 09:40 (42 72 hours ago), /archive/bridge-descriptors/server-descriptors/ = 2020-06-29 09:17 (43 72 hours ago), /archive/bridge-descriptors/statuses/ = 2020-06-29 09:03 (43 72 hours ago), /archive/bridge-pool-assignments/ = 2020-06-29 09:51 (42 72 hours ago), /archive/exit-lists/ = 2020-06-29 03:25 (49 72 hours ago), /archive/onionperf/ = 2020-06-29 03:26 (49 72 hours ago), /archive/relay-descriptors/ = 2020-06-29 03:27 (49 720 hours ago), /archive/relay-descriptors/bandwidths/ = 2020-06-29 06:50 (45 72 hours ago), /archive/relay-descriptors/consensuses/ = 2020-06-29 03:38 (48 72 hours ago), /archive/relay-descriptors/extra-infos/ = 2020-06-29 08:47 (43 72 hours ago), /archive/relay-descriptors/microdescs/ = 2020-06-29 03:29 (49 72 hours ago), /archive/r elay-descriptors/server-descriptors/ = 2020-06-29 08:29 (44 72 hours ago), /archive/relay-descriptors/votes/ = 2020-06-29 04:25 (48 72 hours ago), /archive/snowflakes/ = 2020-06-29 09:50 (42 72 hours ago), /archive/webstats/ = 2020-06-29 09:52 (42 72 hours ago), /recent/bridgedb-metrics/ = 2020-06-28 21:40 (54 60 hours ago), /recent/bridge-descriptors/extra-infos/ = 2020-07-01 04:09 (0 3 hours ago), /recent/bridge-descriptors/server-descriptors/ = 2020-07-01 04:09 (0 3 hours ago), /recent/bridge-descriptors/statuses/ = 2020-07-01 04:09 (0 3 hours ago), /recent/bridge-pool-assignments/ = 2020-07-01 00:09 (4 30 hours ago), /recent/exit-lists/ = 2020-07-01 04:02 (0 3 hours ago), /recent/onionperf/ = 2020-07-01 02:10 (2 30 hours ago), /recent/relay-descriptors/bandwidths/ = 2020-07-01 04:26 (0 3 hours ago), /recent/relay-descriptors/consensuses/ = 2020-07-01 04:20 (0 3 hours ago), /recent/relay-descriptors/extra-infos/ = 2020-07-01 04:22 (0 3 hours ago), /recent/relay-desc riptors/microdescs/consensus-microdesc/ = 2020-07-01 04:21 (0 3 hours ago), /recent/relay-descriptors/microdescs/micro/ = 2020-07-01 04:22 (0 3 hours ago), /recent/relay-descriptors/server-descriptors/ = 2020-07-01 04:22 (0 3 hours ago), /recent/relay-descriptors/votes/ = 2020-07-01 04:21 (0 3 hours ago), /recent/snowflakes/ = 2020-06-30 17:40 (10 30 hours ago), /recent/webstats/ = 2020-07-01 01:47 (2 30 hours ago)

1 0

** PROBLEM Service Alert: global/collector is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 01 Jul '20

01 Jul '20

***** Icinga ***** Notification Type: PROBLEM Service: collector Host: global Address: global State: WARNING Date/Time: Wed Jul 1 03:15:53 UTC 2020 Additional Info: WARNING: Got a valid response from https://collector.torproject.org/index/index.json with at least one timestamp being outdated: /recent/relay-descriptors/bandwidths/ = 2020-07-01 00:11 (3 = 3 hours ago), /recent/relay-descriptors/consensuses/ = 2020-07-01 00:05 (3 = 3 hours ago), /recent/relay-descriptors/microdescs/consensus-microdesc/ = 2020-07-01 00:05 (3 = 3 hours ago), /recent/relay-descriptors/votes/ = 2020-07-01 00:05 (3 = 3 hours ago)

1 0

** RECOVERY Service Alert: global/collector is OK **
by nagios＠hetzner-hel1-01.torproject.org 24 Jun '20

24 Jun '20

***** Icinga ***** Notification Type: RECOVERY Service: collector Host: global Address: global State: OK Date/Time: Wed Jun 24 17:06:01 UTC 2020 Additional Info: OK: Got a valid response from https://collector.torproject.org/index/index.json with recent timestamps: /archive/bridgedb-metrics/ = 2020-06-24 16:12 (0 72 hours ago), /archive/bridge-descriptors/extra-infos/ = 2020-06-24 16:04 (1 72 hours ago), /archive/bridge-descriptors/server-descriptors/ = 2020-06-24 15:54 (1 72 hours ago), /archive/bridge-descriptors/statuses/ = 2020-06-24 15:48 (1 72 hours ago), /archive/bridge-pool-assignments/ = 2020-06-24 16:11 (0 72 hours ago), /archive/exit-lists/ = 2020-06-24 11:53 (5 72 hours ago), /archive/onionperf/ = 2020-06-24 11:54 (5 72 hours ago), /archive/relay-descriptors/ = 2020-06-24 11:55 (5 720 hours ago), /archive/relay-descriptors/bandwidths/ = 2020-06-24 14:00 (3 72 hours ago), /archive/relay-descriptors/consensuses/ = 2020-06-24 12:03 (5 72 hours ago), /archive/relay-descriptors/extra-infos/ = 2020-06-24 15:38 (1 72 hours ago), /archive/relay-descriptors/microdescs/ = 2020-06-24 11:56 (5 72 hours ago), /archive/relay-descrip tors/server-descriptors/ = 2020-06-24 15:26 (1 72 hours ago), /archive/relay-descriptors/votes/ = 2020-06-24 12:29 (4 72 hours ago), /archive/snowflakes/ = 2020-06-24 16:11 (0 72 hours ago), /archive/webstats/ = 2020-06-24 16:12 (0 72 hours ago), /recent/bridgedb-metrics/ = 2020-06-24 05:40 (11 60 hours ago), /recent/bridge-descriptors/extra-infos/ = 2020-06-24 16:09 (0 3 hours ago), /recent/bridge-descriptors/server-descriptors/ = 2020-06-24 16:09 (0 3 hours ago), /recent/bridge-descriptors/statuses/ = 2020-06-24 16:09 (0 3 hours ago), /recent/bridge-pool-assignments/ = 2020-06-24 00:09 (16 30 hours ago), /recent/exit-lists/ = 2020-06-24 16:02 (1 3 hours ago), /recent/onionperf/ = 2020-06-24 02:10 (14 30 hours ago), /recent/relay-descriptors/bandwidths/ = 2020-06-24 16:35 (0 3 hours ago), /recent/relay-descriptors/consensuses/ = 2020-06-24 16:05 (1 3 hours ago), /recent/relay-descriptors/extra-infos/ = 2020-06-24 16:05 (1 3 hours ago), /recent/relay-descriptors/microd escs/consensus-microdesc/ = 2020-06-24 16:05 (1 3 hours ago), /recent/relay-descriptors/microdescs/micro/ = 2020-06-24 16:05 (1 3 hours ago), /recent/relay-descriptors/server-descriptors/ = 2020-06-24 16:05 (1 3 hours ago), /recent/relay-descriptors/votes/ = 2020-06-24 16:05 (1 3 hours ago), /recent/snowflakes/ = 2020-06-23 17:40 (23 30 hours ago), /recent/webstats/ = 2020-06-24 01:47 (15 30 hours ago)

1 0

** PROBLEM Service Alert: global/collector is CRITICAL **
by nagios＠hetzner-hel1-01.torproject.org 24 Jun '20

24 Jun '20

***** Icinga ***** Notification Type: PROBLEM Service: collector Host: global Address: global State: CRITICAL Date/Time: Wed Jun 24 06:36:01 UTC 2020 Additional Info: CRITICAL: Got a valid response from https://collector.torproject.org/index/index.json with at least one timestamp being critically outdated: /archive/exit-lists/ = 2020-06-21 03:25 (75 = 72 + 3 hours ago), /archive/onionperf/ = 2020-06-21 03:26 (75 = 72 + 3 hours ago), /archive/relay-descriptors/consensuses/ = 2020-06-21 03:32 (75 = 72 + 3 hours ago), /archive/relay-descriptors/microdescs/ = 2020-06-21 03:27 (75 = 72 + 3 hours ago)

1 0

** PROBLEM Service Alert: global/collector is WARNING **
by nagios＠hetzner-hel1-01.torproject.org 24 Jun '20

24 Jun '20

***** Icinga ***** Notification Type: PROBLEM Service: collector Host: global Address: global State: WARNING Date/Time: Wed Jun 24 03:36:01 UTC 2020 Additional Info: WARNING: Got a valid response from https://collector.torproject.org/index/index.json with at least one timestamp being outdated: /archive/exit-lists/ = 2020-06-21 03:25 (72 = 72 hours ago), /archive/onionperf/ = 2020-06-21 03:26 (72 = 72 hours ago), /archive/relay-descriptors/consensuses/ = 2020-06-21 03:32 (72 = 72 hours ago), /archive/relay-descriptors/microdescs/ = 2020-06-21 03:27 (72 = 72 hours ago)

1 0

** RECOVERY Service Alert: onionoo-backend-02/network service - onionoo varnish is OK **
by nagios＠hetzner-hel1-01.torproject.org 19 Jun '20

19 Jun '20

***** Icinga ***** Notification Type: RECOVERY Service: network service - onionoo varnish Host: onionoo-backend-02 Address: 116.202.120.178 State: OK Date/Time: Fri Jun 19 10:35:56 UTC 2020 Additional Info: OK: Valid response with recent timestamps (3213 sec): relays_published=2020-06-19 10:00:00, bridges_published=2020-06-19 09:42:18

1 0

** RECOVERY Service Alert: onionoo-frontend-02/network service - onionoo full service check is OK **
by nagios＠hetzner-hel1-01.torproject.org 19 Jun '20

19 Jun '20

***** Icinga ***** Notification Type: RECOVERY Service: network service - onionoo full service check Host: onionoo-frontend-02 Address: 49.12.57.137 State: OK Date/Time: Fri Jun 19 10:35:46 UTC 2020 Additional Info: OK: Valid response with recent timestamps (3198 sec): relays_published=2020-06-19 10:00:00, bridges_published=2020-06-19 09:42:18

1 0