network-health

network-health@lists.torproject.org

May 2026

2 participants
2 discussions

Mid-month descriptors from collector-rs?
by David Fifield 06 Jul '26

06 Jul '26

It used to be that the "archive" directory of collector.torproject.org would serve unchanging descriptor tarballs from past months, along with a more or less continuously updated tarball for the current month. But now it seems that there is no tarball for the current month. See here: https://collector.torproject.org/archive/bridge-descriptors/extra-infos/ https://web.archive.org/web/20260504132617/https://collector.torproject.org… The date is currently 2026-05-04, but the latest tarball is extra-infos-2026-04.tar.xz 2026-05-02 03:42 218M Is there a way to get, for example, descriptors from May 3, without waiting until the end of the month? There is the "recent" directory which might work, but it only goes back a few days. At this moment, "recent" covers from 2026-04-30 to 2026-05-04, but if I were to check on 2026-05-20, say, I might not be able to get descriptors from 2026-05-10. https://collector.torproject.org/recent/bridge-descriptors/extra-infos/ https://web.archive.org/web/20260504132701/https://collector.torproject.org… The reason I'm asking: When I make monthly graphs of snowflake bridges, I usually wait a few days into the next month and download the next month's descriptor to include it with the data. The reason is that the tarball for May, for example, contains descriptors that cover the end of April. Without including the beginning of the next month's data, I found, the last 1–2 days of the previous month's data can be incomplete. For example, I just used https://gitlab.torproject.org/dcf/snowflake-graphs to compute statistics using tarballs up to extra-infos-2026-04.tar.xz. This is showing just one bridge (which consists of 12 tor instances). Notice the last few days of April 2026, the "coverage" drops from from 12.0/12.0 to 9.95/12.0: date, fingerprint, transport, users, num_instances,coverage 2026-04-24,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,14592.87,12.00,12.00 2026-04-25,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,14615.31,12.00,12.00 2026-04-26,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,14992.47,12.00,12.00 2026-04-27,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,15056.68,12.00,12.00 2026-04-28,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,15250.09,12.00,12.00 2026-04-29,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,15034.07,12.00,11.92 2026-04-30,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,12877.20,12.00,9.95 If I regenerate the statistics, manually including also the "recent" descriptors, the coverage gets "filled in" (and the users count correspondingly goes up): date, fingerprint, transport, users, num_instances,coverage 2026-04-24,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,14592.87,12.00,12.00 2026-04-25,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,14615.31,12.00,12.00 2026-04-26,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,14992.47,12.00,12.00 2026-04-27,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,15056.68,12.00,12.00 2026-04-28,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,15250.09,12.00,12.00 2026-04-29,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,15099.58,12.00,12.00 2026-04-30,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,14834.64,12.00,12.00 2026-05-01,5481936581E23D2D178105D44DB6915AB06BFB7F,snowflake,14781.53,12.00,12.00

2 3

Why are some recent relay extra-infos so much larger than others?
by David Fifield 18 May '26

18 May '26

The sizes of recent relay extra-info files are really non-uniform. Some are ≈2 MB, while a few are around 100 MB. Why is that? https://collector.torproject.org/recent/relay-descriptors/extra-infos/ https://web.archive.org/web/20260504124134/https://collector.torproject.org… The timestamps of the larger files are around 02:15. collector.torproject.org/recent/relay-descriptors/extra-infos$ du -b * | awk '{printf "%s %9d\n", $2, $1}' 2026-04-30-14-11-19-extra-infos 1276042 2026-04-30-15-14-46-extra-infos 1247336 2026-04-30-16-10-53-extra-infos 2855275 2026-04-30-17-15-35-extra-infos 1753035 2026-04-30-18-15-14-extra-infos 2060495 2026-04-30-19-12-44-extra-infos 2660025 2026-04-30-20-14-53-extra-infos 1568362 2026-04-30-21-13-22-extra-infos 1761678 2026-04-30-22-12-10-extra-infos 1413393 2026-04-30-23-12-17-extra-infos 1905710 2026-05-01-00-11-08-extra-infos 1752284 2026-05-01-01-11-37-extra-infos 1534231 2026-05-01-02-15-15-extra-infos 111364852 2026-05-01-02-16-14-extra-infos 1901771 2026-05-01-03-10-54-extra-infos 2386246 2026-05-01-04-13-07-extra-infos 2167008 2026-05-01-05-13-50-extra-infos 1885811 2026-05-01-06-11-28-extra-infos 1963598 2026-05-01-07-14-22-extra-infos 2573871 2026-05-01-08-12-47-extra-infos 1420773 2026-05-01-09-14-42-extra-infos 1172538 2026-05-01-10-11-11-extra-infos 2023018 2026-05-01-11-14-24-extra-infos 2755937 2026-05-01-12-14-47-extra-infos 2134339 2026-05-01-13-10-51-extra-infos 2432106 2026-05-01-14-12-04-extra-infos 1463049 2026-05-01-15-13-41-extra-infos 1408304 2026-05-01-16-11-20-extra-infos 1214815 2026-05-01-17-14-52-extra-infos 1760421 2026-05-01-18-13-18-extra-infos 1674648 2026-05-01-19-14-23-extra-infos 1702962 2026-05-01-20-13-36-extra-infos 1737346 2026-05-01-21-10-54-extra-infos 1926319 2026-05-01-22-12-52-extra-infos 1667868 2026-05-01-23-10-44-extra-infos 1555635 2026-05-02-00-13-03-extra-infos 1999089 2026-05-02-01-11-28-extra-infos 2173352 2026-05-02-02-15-32-extra-infos 100456075 2026-05-02-02-15-58-extra-infos 1528017 2026-05-02-03-16-55-extra-infos 1789647 2026-05-02-04-14-34-extra-infos 2824311 2026-05-02-05-13-56-extra-infos 2511073 2026-05-02-06-15-40-extra-infos 1742844 2026-05-02-07-11-59-extra-infos 2570830 2026-05-02-08-12-55-extra-infos 1371061 2026-05-02-09-14-25-extra-infos 1628251 2026-05-02-10-13-19-extra-infos 1571755 2026-05-02-11-11-02-extra-infos 1821608 2026-05-02-12-12-16-extra-infos 1371271 2026-05-02-13-11-58-extra-infos 1661234 2026-05-02-14-11-01-extra-infos 1574868 2026-05-02-15-11-16-extra-infos 1242763 2026-05-02-16-10-51-extra-infos 1342396 2026-05-02-17-12-29-extra-infos 1888936 2026-05-02-18-13-52-extra-infos 2304888 2026-05-02-19-12-30-extra-infos 2062860 2026-05-02-20-10-59-extra-infos 1352409 2026-05-02-21-14-36-extra-infos 1781758 2026-05-02-22-14-43-extra-infos 2905690 2026-05-02-23-11-41-extra-infos 1102832 2026-05-03-00-14-02-extra-infos 2498869 2026-05-03-01-13-17-extra-infos 2065183 2026-05-03-02-11-55-extra-infos 1270464 2026-05-03-02-15-15-extra-infos 95955891 2026-05-03-03-12-59-extra-infos 1642662 2026-05-03-04-12-22-extra-infos 1666690 2026-05-03-05-14-40-extra-infos 1917854 2026-05-03-06-11-22-extra-infos 1521837 2026-05-03-07-14-49-extra-infos 2303808 2026-05-03-08-12-57-extra-infos 1712003 2026-05-03-09-13-51-extra-infos 1186784 2026-05-03-10-12-13-extra-infos 1366221 2026-05-03-11-15-02-extra-infos 2046367 2026-05-03-12-15-20-extra-infos 1850313 2026-05-03-13-12-08-extra-infos 1817772 2026-05-03-14-11-49-extra-infos 1906482 2026-05-03-15-10-58-extra-infos 1995252 2026-05-03-16-11-14-extra-infos 2764421 2026-05-03-17-14-16-extra-infos 2263420 2026-05-03-18-11-22-extra-infos 1383370 2026-05-03-19-15-02-extra-infos 2885490 2026-05-03-20-13-33-extra-infos 1640791 2026-05-03-21-13-50-extra-infos 1704498 2026-05-03-22-15-00-extra-infos 1998454 2026-05-03-23-12-27-extra-infos 1963243 2026-05-04-00-11-32-extra-infos 1576046 2026-05-04-01-11-25-extra-infos 2282145 2026-05-04-02-15-22-extra-infos 97728439 2026-05-04-02-16-07-extra-infos 1823340 2026-05-04-03-11-09-extra-infos 1136708 2026-05-04-04-13-17-extra-infos 733055 2026-05-04-05-12-45-extra-infos 2051394 2026-05-04-06-12-31-extra-infos 1921639 2026-05-04-07-14-56-extra-infos 540867 2026-05-04-08-14-21-extra-infos 1347267 2026-05-04-09-12-37-extra-infos 757562 2026-05-04-10-17-40-extra-infos 5263330 2026-05-04-11-14-42-extra-infos 1783890 2026-05-04-12-14-28-extra-infos 1537615 2026-05-04-13-13-04-extra-infos 2080428

2 1