December 2022 - network-health - lists.torproject.org

Snowflake stats available?
by Rainer Rehak (FIfF) 23 Mar '24

23 Mar '24

Dear team, thank you for your great work. We are a tech NGO from Germany and startet a little campaign here to encourage users to run a snowflake to help circumvent cencorship (e.g. Iran, Russia): https://snowflake.fiff.de/index_en.html Now we get a lot of questions about how many ppl actually do run snowflakes, but on https://metrics.torproject.org we couldn't find any data on snowflake. Could this data be make available or are there reasons for hiding it? Thanks so much Rainer -- Forum InformatikerInnen für Frieden und gesellschaftliche Verantwortung e. V. Goetheplatz 4, D-28203 Bremen Telefon +49 421 33659255 - Fax +49 421 33659256 E-Mail: fiff(a)fiff.de - https://www.fiff.de - https://twitter.com/fiff_de Unterstützen und Spenden: https://www.fiff.de/about/mitgliedschaft-spenden PGP: https://keys.mailvelope.com/pks/lookup?op=get&search=rainer.rehak@fiff.de FP: 63D2 9BCB 65CB FA55 F851 BDE3 0CAA 0E82 8193 953E

3 3

How is a relay's uptime determined?
by arf20 21 Dec '22

21 Dec '22

Hello there, I run a tor middle relay, and last night I restarted the service due to an update. Then, looking up the relay in the Tor site, it looks like I lost all the uptime and flags. A bit annoying since I have had the server down for several minutes without consequences in other times. I was 5 days away from the t-shirt :( I was just wondering under what circumstances the relay's uptime is reset, if possible. Thanks. -- arf20

2 2

Converter of Tor metrics data to Parquet, and some other stuff
by Thomas Lörtsch 20 Dec '22

20 Dec '22

Hi, I was working as a volunteer with the Metrics team under the auspices of Karsten Loesing. He ended that collaboration in 2016 in a rather unfortunate way and I have no idea if he ever looked at my code again. I do still have the code that I worked on and I still think it has some value: the main contribution is a converter from Metrics’ own data format to Parquet. Parquet is a data format optimized for Big Data analytics in tools like Spark and related technologies e.g. Jupyter notebooks. I also did spend a lot of time in understanding, organizing and writing down what all the data points that Metrics collects mean, how they correlate etc. In the end all this was meant to drive a fantastic visualization of Tor data, but that part did never materialize. However, the decision for Parquet and Spark was not trivial back then, but seems to have proven to be a good one since both still seem to be strong offerings in the Big Data space. I haven’t since worked on the code, it never had a proper test suite and Metrics’ data formats have probably evolved from then. Also, I haven’t followed the work of the Metrics team and maybe you have developed something much better in the meantime. Back then, six years ago, most aggregation was done in Postgres, and Spark would most probably have outperformed the Postgres RDBMS easily. By the way, I just remember I also developed a giant relational schema for all of Metrics’ data... Anyway, if any of this sounds interesting to you please contact me (off-list, as I don’t follow the lists anymore). I will be happy to provide you access to the GitLab repo, spend a few hours to get myself up to speed again on what I was doing back then, and help you evaluate if it may be of any value to you. I will however not work on the code again in earnest, as after Karsten kicked me out I completely switched back to what I was doing before I joined Tor. Best, Thomas

1 0