[tor-bugs] #25100 [Metrics/CollecTor]: Make CollecTor's webstats module use less RAM and CPU time

Tor Bug Tracker & Wiki blackhole at torproject.org
Wed Jan 31 16:33:40 UTC 2018


#25100: Make CollecTor's webstats module use less RAM and CPU time
-------------------------------+--------------------------
 Reporter:  karsten            |          Owner:  iwakeh
     Type:  enhancement        |         Status:  accepted
 Priority:  High               |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+--------------------------

Comment (by iwakeh):

 See the patch in the child ticket for metrics-lib.
 It shortens processing time of 516 meronense logs to four minutes.
 {{{
 2018-01-31 16:31:37,805 INFO o.t.c.c.CollecTorMain:66 Starting webstats
 module of CollecTor.
 2018-01-31 16:31:37,910 INFO o.t.c.w.SanitizeWeblogs:98 Found log files
 for 1 virtual hosts.
 2018-01-31 16:31:37,911 INFO o.t.c.w.SanitizeWeblogs:105 Processing logs
 for metrics.torproject.org on meronense.torproject.org.
 2018-01-31 16:35:21,428 INFO o.t.c.c.CollecTorMain:68 Terminating webstats
 module of CollecTor.
 2018-01-31 16:35:21,430 INFO o.t.c.c.ShutdownHook:23 Shutdown in progress
 ...
 2018-01-31 16:35:21,432 INFO o.t.c.cron.Scheduler:127 Waiting at most 10
 minutes for termination of running tasks ...
 2018-01-31 16:35:21,432 INFO o.t.c.cron.Scheduler:132 Shutdown of all
 scheduled tasks completed successfully.
 2018-01-31 16:35:21,433 INFO o.t.c.c.ShutdownHook:25 Shutdown finished.
 Exiting.
 }}}

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25100#comment:2>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online


More information about the tor-bugs mailing list