From onionperf-monitor at nymity.ch Tue Aug 4 04:25:58 2020 From: onionperf-monitor at nymity.ch (Monit) Date: Tue, 04 Aug 2020 04:25:58 GMT Subject: [metrics-alerts] monit alert -- Connection failed op-nl3-tgen Message-ID: <1596515158.246bdccb4aaac69e@op-hk3> Connection failed Service op-nl3-tgen Date: Tue, 04 Aug 2020 04:25:56 Action: alert Host: op-hk3 Description: failed protocol test [DEFAULT] at [op-nl3.onionperf.torproject.net]:8080 [TCP/IP] -- Connection timed out From onionperf-monitor at nymity.ch Tue Aug 4 04:36:02 2020 From: onionperf-monitor at nymity.ch (Monit) Date: Tue, 04 Aug 2020 04:36:02 GMT Subject: [metrics-alerts] monit alert -- Connection succeeded op-nl3-tgen Message-ID: <1596515763.d7d4a87c2594dad6@op-hk3> Connection succeeded Service op-nl3-tgen Date: Tue, 04 Aug 2020 04:36:00 Action: alert Host: op-hk3 Description: connection succeeded to [op-nl3.onionperf.torproject.net]:8080 [TCP/IP] From karsten at torproject.org Wed Aug 19 09:37:04 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:37:04 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Monit instance changed op-nl3 Message-ID: <1597829823.bff930cf1079fc56@op-nl3> Monit instance changed Service op-nl3 Date: Wed, 19 Aug 2020 09:37:03 Action: start Host: op-nl3 Description: Monit 5.26.0 started From karsten at torproject.org Wed Aug 19 09:49:11 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:11 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done tgen-server Message-ID: <1597830551.3a2dadb2abd12656@op-nl3> Action done Service tgen-server Date: Wed, 19 Aug 2020 09:49:11 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:11 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:11 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done onionperf Message-ID: <1597830550.9e49690c1bd6f270@op-nl3> Action done Service onionperf Date: Wed, 19 Aug 2020 09:49:10 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:12 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:12 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done torctl-client-log Message-ID: <1597830551.15696664d3112971@op-nl3> Action done Service torctl-client-log Date: Wed, 19 Aug 2020 09:49:11 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:11 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:11 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done tgen-client Message-ID: <1597830551.a5ad2b402881a35c@op-nl3> Action done Service tgen-client Date: Wed, 19 Aug 2020 09:49:11 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:12 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:12 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done disk Message-ID: <1597830552.6b4e1e1061ca60ae@op-nl3> Action done Service disk Date: Wed, 19 Aug 2020 09:49:11 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:12 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:12 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done op-hk3-tgen Message-ID: <1597830552.ababa411fa80d15d@op-nl3> Action done Service op-hk3-tgen Date: Wed, 19 Aug 2020 09:49:12 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:11 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:11 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done tgen-client-log Message-ID: <1597830551.994da545d842d686@op-nl3> Action done Service tgen-client-log Date: Wed, 19 Aug 2020 09:49:11 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:12 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:12 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done op-nl3-tgen Message-ID: <1597830552.548dd09a58db6ec7@op-nl3> Action done Service op-nl3-tgen Date: Wed, 19 Aug 2020 09:49:12 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:12 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:12 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done op-us3-tgen Message-ID: <1597830552.1e3e2e5649d52025@op-nl3> Action done Service op-us3-tgen Date: Wed, 19 Aug 2020 09:49:12 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:13 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:13 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done op-nl3 Message-ID: <1597830552.51f617722cb6eb16@op-nl3> Action done Service op-nl3 Date: Wed, 19 Aug 2020 09:49:12 Action: alert Host: op-nl3 Description: stop action done From karsten at torproject.org Wed Aug 19 09:49:49 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:49 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done onionperf Message-ID: <1597830589.4dd010dff493186e@op-nl3> Action done Service onionperf Date: Wed, 19 Aug 2020 09:49:49 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:49 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:49 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done tgen-client Message-ID: <1597830589.3fad8d9bcca00359@op-nl3> Action done Service tgen-client Date: Wed, 19 Aug 2020 09:49:49 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:50 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:50 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done tgen-client-log Message-ID: <1597830589.16e0bb109529ecca@op-nl3> Action done Service tgen-client-log Date: Wed, 19 Aug 2020 09:49:49 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:50 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:50 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done torctl-client-log Message-ID: <1597830589.839c6e7fa42d46eb@op-nl3> Action done Service torctl-client-log Date: Wed, 19 Aug 2020 09:49:49 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:49 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:49 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done tgen-server Message-ID: <1597830589.fbe469c3fde69f9d@op-nl3> Action done Service tgen-server Date: Wed, 19 Aug 2020 09:49:49 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:50 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:50 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done disk Message-ID: <1597830590.1759701ca56c3527@op-nl3> Action done Service disk Date: Wed, 19 Aug 2020 09:49:49 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:51 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:51 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done op-nl3 Message-ID: <1597830590.7a52265b475dbf43@op-nl3> Action done Service op-nl3 Date: Wed, 19 Aug 2020 09:49:50 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:50 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:50 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done op-hk3-tgen Message-ID: <1597830590.ec13489acf30c6c@op-nl3> Action done Service op-hk3-tgen Date: Wed, 19 Aug 2020 09:49:50 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:50 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:50 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done op-nl3-tgen Message-ID: <1597830590.7d54f1b5cbc714e3@op-nl3> Action done Service op-nl3-tgen Date: Wed, 19 Aug 2020 09:49:50 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:49:50 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:49:50 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Action done op-us3-tgen Message-ID: <1597830590.1e3831f84a5b4269@op-nl3> Action done Service op-us3-tgen Date: Wed, 19 Aug 2020 09:49:50 Action: alert Host: op-nl3 Description: start action done From karsten at torproject.org Wed Aug 19 09:56:04 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:56:04 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Monit instance changed op-us4 Message-ID: <1597830964.7a24499e95592ada@op-us4> Monit instance changed Service op-us4 Date: Wed, 19 Aug 2020 09:56:03 Action: start Host: op-us4 Description: Monit 5.26.0 started From karsten at torproject.org Wed Aug 19 09:56:49 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:56:49 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Monit instance changed op-nl4 Message-ID: <1597831008.58279fe654c47563@op-nl4> Monit instance changed Service op-nl4 Date: Wed, 19 Aug 2020 09:56:48 Action: start Host: op-nl4 Description: Monit 5.26.0 started From karsten at torproject.org Wed Aug 19 09:56:55 2020 From: karsten at torproject.org (Karsten Loesing) Date: Wed, 19 Aug 2020 09:56:55 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Monit instance changed op-hk4 Message-ID: <1597831013.1d4c217665bbd623@op-hk4> Monit instance changed Service op-hk4 Date: Wed, 19 Aug 2020 09:56:51 Action: start Host: op-hk4 Description: Monit 5.26.0 started From karsten at torproject.org Thu Aug 20 02:01:46 2020 From: karsten at torproject.org (Karsten Loesing) Date: Thu, 20 Aug 2020 02:01:46 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Connection failed op-hk3-tgen Message-ID: <1597888905.799351fe6169f84e@op-nl3> Connection failed Service op-hk3-tgen Date: Thu, 20 Aug 2020 02:01:45 Action: alert Host: op-nl3 Description: failed protocol test [DEFAULT] at [op-hk3.onionperf.torproject.net]:8080 [TCP/IP] -- Connection timed out From karsten at torproject.org Thu Aug 20 02:11:47 2020 From: karsten at torproject.org (Karsten Loesing) Date: Thu, 20 Aug 2020 02:11:47 +0000 (UTC) Subject: [metrics-alerts] monit alert -- Connection succeeded op-hk3-tgen Message-ID: <1597889506.df85d89b0067788d@op-nl3> Connection succeeded Service op-hk3-tgen Date: Thu, 20 Aug 2020 02:11:46 Action: alert Host: op-nl3 Description: connection succeeded to [op-hk3.onionperf.torproject.net]:8080 [TCP/IP] From nagios at hetzner-hel1-01.torproject.org Tue Aug 25 07:53:47 2020 From: nagios at hetzner-hel1-01.torproject.org (nagios at hetzner-hel1-01.torproject.org) Date: Tue, 25 Aug 2020 07:53:47 +0000 (UTC) Subject: [metrics-alerts] ** PROBLEM Service Alert: global/collector is WARNING ** Message-ID: <20200825075347.5B7E53EB20@hetzner-hel1-01.torproject.org> ***** Icinga ***** Notification Type: PROBLEM Service: collector Host: global Address: global State: WARNING Date/Time: Tue Aug 25 07:53:47 UTC 2020 Additional Info: WARNING: Got a valid response from https://collector.torproject.org/index/index.json with at least one timestamp being outdated: /recent/snowflakes/ = 2020-08-24 01:40 (30 = 30 hours ago) From nagios at hetzner-hel1-01.torproject.org Tue Aug 25 10:53:47 2020 From: nagios at hetzner-hel1-01.torproject.org (nagios at hetzner-hel1-01.torproject.org) Date: Tue, 25 Aug 2020 10:53:47 +0000 (UTC) Subject: [metrics-alerts] ** PROBLEM Service Alert: global/collector is CRITICAL ** Message-ID: <20200825105347.60AE03EB20@hetzner-hel1-01.torproject.org> ***** Icinga ***** Notification Type: PROBLEM Service: collector Host: global Address: global State: CRITICAL Date/Time: Tue Aug 25 10:53:47 UTC 2020 Additional Info: CRITICAL: Got a valid response from https://collector.torproject.org/index/index.json with at least one timestamp being critically outdated: /recent/snowflakes/ = 2020-08-24 01:40 (33 = 30 + 3 hours ago) From nagios at hetzner-hel1-01.torproject.org Tue Aug 25 17:53:47 2020 From: nagios at hetzner-hel1-01.torproject.org (nagios at hetzner-hel1-01.torproject.org) Date: Tue, 25 Aug 2020 17:53:47 +0000 (UTC) Subject: [metrics-alerts] ** RECOVERY Service Alert: global/collector is OK ** Message-ID: <20200825175347.7E1003EB20@hetzner-hel1-01.torproject.org> ***** Icinga ***** Notification Type: RECOVERY Service: collector Host: global Address: global State: OK Date/Time: Tue Aug 25 17:53:47 UTC 2020 Additional Info: OK: Got a valid response from https://collector.torproject.org/index/index.json with recent timestamps: /archive/bridgedb-metrics/ = 2020-08-25 09:09 (8 72 hours ago), /archive/bridge-descriptors/extra-infos/ = 2020-08-25 08:58 (8 72 hours ago), /archive/bridge-descriptors/server-descriptors/ = 2020-08-25 08:31 (9 72 hours ago), /archive/bridge-descriptors/statuses/ = 2020-08-25 07:59 (9 72 hours ago), /archive/bridge-pool-assignments/ = 2020-08-25 09:08 (8 72 hours ago), /archive/exit-lists/ = 2020-08-25 03:25 (14 72 hours ago), /archive/onionperf/ = 2020-08-25 03:26 (14 72 hours ago), /archive/relay-descriptors/ = 2020-08-25 03:26 (14 720 hours ago), /archive/relay-descriptors/bandwidths/ = 2020-08-25 05:39 (12 72 hours ago), /archive/relay-descriptors/consensuses/ = 2020-08-25 03:34 (14 72 hours ago), /archive/relay-descriptors/extra-infos/ = 2020-08-25 07:46 (10 72 hours ago), /archive/relay-descriptors/microdescs/ = 2020-08-25 03:27 (14 72 hours ago), /archive/relay- descriptors/server-descriptors/ = 2020-08-25 07:17 (10 72 hours ago), /archive/relay-descriptors/votes/ = 2020-08-25 03:59 (13 72 hours ago), /archive/snowflakes/ = 2020-08-25 09:08 (8 72 hours ago), /archive/webstats/ = 2020-08-25 09:09 (8 72 hours ago), /recent/bridgedb-metrics/ = 2020-08-24 21:40 (20 60 hours ago), /recent/bridge-descriptors/extra-infos/ = 2020-08-25 17:09 (0 3 hours ago), /recent/bridge-descriptors/server-descriptors/ = 2020-08-25 17:09 (0 3 hours ago), /recent/bridge-descriptors/statuses/ = 2020-08-25 17:09 (0 3 hours ago), /recent/bridge-pool-assignments/ = 2020-08-25 00:09 (17 30 hours ago), /recent/exit-lists/ = 2020-08-25 17:02 (0 3 hours ago), /recent/onionperf/ = 2020-08-25 02:10 (15 30 hours ago), /recent/relay-descriptors/bandwidths/ = 2020-08-25 17:35 (0 3 hours ago), /recent/relay-descriptors/consensuses/ = 2020-08-25 17:05 (0 3 hours ago), /recent/relay-descriptors/extra-infos/ = 2020-08-25 17:05 (0 3 hours ago), /recent/relay-descripto rs/microdescs/consensus-microdesc/ = 2020-08-25 17:05 (0 3 hours ago), /recent/relay-descriptors/microdescs/micro/ = 2020-08-25 17:05 (0 3 hours ago), /recent/relay-descriptors/server-descriptors/ = 2020-08-25 17:05 (0 3 hours ago), /recent/relay-descriptors/votes/ = 2020-08-25 17:05 (0 3 hours ago), /recent/snowflakes/ = 2020-08-25 17:40 (0 30 hours ago), /recent/webstats/ = 2020-08-25 01:46 (16 30 hours ago)