- metrics-alerts - lists.torproject.org

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/usr/lib/python3/dist-packages/urllib3/response.py", line 768, in _error_catcher yield File "/usr/lib/python3/dist-packages/urllib3/response.py", line 1236, in read_chunked chunk = self._handle_chunk(amt) File "/usr/lib/python3/dist-packages/urllib3/response.py", line 1173, in _handle_chunk value = self._fp._safe_read(amt) # type: ignore[union-attr] File "/usr/lib/python3.13/http/client.py", line 644, in _safe_read raise IncompleteRead(data, amt-len(data)) http.client.IncompleteRead: IncompleteRead(6218 bytes read, 4022 more expected) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/requests/models.py", line 820, in generate yield from self.raw.stream(chunk_size, decode_content=True) File "/usr/lib/python3/dist-packages/urllib3/response.py", line 1077, in stream yield from self.read_chunked(amt, decode_content=decode_content) File "/usr/lib/python3/dist-packages/urllib3/response.py", line 1216, in read_chunked with self._error_catcher(): ~~~~~~~~~~~~~~~~~~~^^ File "/usr/lib/python3.13/contextlib.py", line 162, in __exit__ self.gen.throw(value) ~~~~~~~~~~~~~~^^^^^^^ File "/usr/lib/python3/dist-packages/urllib3/response.py", line 795, in _error_catcher raise ProtocolError(f"Connection broken: {e!r}", e) from e urllib3.exceptions.ProtocolError: ('Connection broken: IncompleteRead(6218 bytes read, 4022 more expected)', IncompleteRead(6218 bytes read, 4022 more expected)) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 31, in <module> details = json.loads(requests.get("https://onionoo.torproject.org/details").text) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/requests/api.py", line 73, in get return request("get", url, params=params, **kwargs) File "/usr/lib/python3/dist-packages/requests/api.py", line 59, in request return session.request(method=method, url=url, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/requests/sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python3/dist-packages/requests/sessions.py", line 746, in send r.content File "/usr/lib/python3/dist-packages/requests/models.py", line 902, in content self._content = b"".join(self.iter_content(CONTENT_CHUNK_SIZE)) or b"" ~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/requests/models.py", line 822, in generate raise ChunkedEncodingError(e) requests.exceptions.ChunkedEncodingError: ('Connection broken: IncompleteRead(6218 bytes read, 4022 more expected)', IncompleteRead(6218 bytes read, 4022 more expected))

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 371, in write_to_textfile f.write(generate_latest(registry)) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 371, in write_to_textfile f.write(generate_latest(registry)) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/network/onionoo", line 676, in <module> write_to_textfile('/srv/onionoo.torproject.org/onionoo/network/metrics', registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 371, in write_to_textfile f.write(generate_latest(registry)) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

Cron <onionoo@onionoo-backend-03> /srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo
by root＠onionoo-backend-03.torproject.org 06 Apr '26

06 Apr '26

Traceback (most recent call last): File "/srv/onionoo.torproject.org/onionoo/monitoring/services/onionoo", line 154, in <module> write_to_textfile(metrics_output_path, registry) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/prometheus_client/exposition.py", line 370, in write_to_textfile with open(tmppath, 'wb') as f: ~~~~^^^^^^^^^^^^^^^ OSError: [Errno 28] No space left on device

1 0

consensus-microdesc missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 06 Apr '26

06 Apr '26

Consensus of type microdesc with (double) checksum 0a9647d67cca95602337d3fbe7d45c111c634ea96424cc0ff764a195339969f2 submitted to translog seasalp by dirauth key maatuska-microdesc not found in archive collector.tpo Found in translog at 2026-04-05T23:55Z Expected in archive no later than 2026-04-06T03:55Z

1 0

consensus-microdesc missing from collector.tpo, was seen in seasalp
by tlogmon＠link.verkligendata.se 06 Apr '26

06 Apr '26

Consensus of type microdesc with (double) checksum 0a9647d67cca95602337d3fbe7d45c111c634ea96424cc0ff764a195339969f2 submitted to translog seasalp by dirauth key gabelmoo-microdesc not found in archive collector.tpo Found in translog at 2026-04-05T23:55Z Expected in archive no later than 2026-04-06T03:55Z

1 0