[tor-bugs] #23243 [Metrics/Website]: Write a specification for Tor web server logs

[Tor Bug Tracker & Wiki]

#23243: Write a specification for Tor web server logs
-----------------------------+--------------------------------
 Reporter:  iwakeh           |          Owner:  metrics-team
     Type:  enhancement      |         Status:  needs_revision
 Priority:  High             |      Milestone:
Component:  Metrics/Website  |        Version:
 Severity:  Normal           |     Resolution:
 Keywords:  metrics-2017     |  Actual Points:
Parent ID:                   |         Points:
 Reviewer:                   |        Sponsor:
-----------------------------+--------------------------------

Comment (by iwakeh):

 Replying to [comment:67 Sebastian]:
 > Yes, that would lose all access to information about the amount of
 requests. We cannot put a number in front of a line to indicate how often
 it is repeated because that isn't what the analysis tools expect.

 Ah, ok.  So, explaining this in addition to what I suggested above
 (comment:65) would be the changes you feel are necessary?
 E.g. at the beginning of 4.3:

  Rewritten log lines are re-assembled into sanitized log files based on
 physical host, virtual host, and request start date.

  All rewritten log lines are sorted alphabetically, so that request order
 cannot be inferred from sanitized log files.  Many of the sanitized log
 lines will now be identical.  But in order to not remove too much useful
 information we keep the identical log lines and thus enable typical web
 log analyzers to operate on the sanitized log files.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/23243#comment:68>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online