[tor-bugs] #30731 [Circumvention/Snowflake]: Publish post-sanitization broker logs

[Tor Bug Tracker & Wiki]

#30731: Publish post-sanitization broker logs
-------------------------------------+-----------------------------------
 Reporter:  dcf                      |          Owner:  (none)
     Type:  task                     |         Status:  needs_information
 Priority:  Medium                   |      Milestone:
Component:  Circumvention/Snowflake  |        Version:
 Severity:  Normal                   |     Resolution:
 Keywords:                           |  Actual Points:
Parent ID:                           |         Points:
 Reviewer:  phw                      |        Sponsor:
-------------------------------------+-----------------------------------

Comment (by dcf):

 Replying to [comment:2 phw]:
 > The `clientid` column appears to be empty:
 > {{{
 > $ cut -d , -f 4 broker.csv | sort -n | uniq
 >
 > clientid
 > }}}
 > Do we need it if it doesn't contain any information?

 We can remove that column. I included the column to show that I would have
 used that information if it were present, but none of the broker's log
 messages has it.

 > The only problem I can think of is somebody using the data set to
 confirm if a given computer was a client or a proxy. Given the low
 resolution of the timestamps, the absence of client IDs, and the
 pseudonymous proxy IDs, I consider the risk low.

 I was thinking, maybe the truncated timestamps don't help so much. Proxies
 poll every 10 seconds, so if you see a certain proxy ID polled 10 times in
 the 00:00:00–00:10:00 interval, and 30 times in the 00:10:00–00:20:00
 interval, then it's a good guess that the proxy was active starting
 00:08:40 and ending 00:15:00. In the graphs, I further truncated the
 timestamps to 24 hours, just to reduce the size of the data (see
 reduce.R). Maybe we should make the timestamps even coarser than 10
 minutes?

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/30731#comment:4>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online