[tor-bugs] #25100 [Metrics/CollecTor]: Make CollecTor's webstats module use less RAM and CPU time
Tor Bug Tracker & Wiki
blackhole at torproject.org
Wed Jan 31 16:33:40 UTC 2018
#25100: Make CollecTor's webstats module use less RAM and CPU time
-------------------------------+--------------------------
Reporter: karsten | Owner: iwakeh
Type: enhancement | Status: accepted
Priority: High | Milestone:
Component: Metrics/CollecTor | Version:
Severity: Normal | Resolution:
Keywords: | Actual Points:
Parent ID: | Points:
Reviewer: | Sponsor:
-------------------------------+--------------------------
Comment (by iwakeh):
See the patch in the child ticket for metrics-lib.
It shortens processing time of 516 meronense logs to four minutes.
{{{
2018-01-31 16:31:37,805 INFO o.t.c.c.CollecTorMain:66 Starting webstats
module of CollecTor.
2018-01-31 16:31:37,910 INFO o.t.c.w.SanitizeWeblogs:98 Found log files
for 1 virtual hosts.
2018-01-31 16:31:37,911 INFO o.t.c.w.SanitizeWeblogs:105 Processing logs
for metrics.torproject.org on meronense.torproject.org.
2018-01-31 16:35:21,428 INFO o.t.c.c.CollecTorMain:68 Terminating webstats
module of CollecTor.
2018-01-31 16:35:21,430 INFO o.t.c.c.ShutdownHook:23 Shutdown in progress
...
2018-01-31 16:35:21,432 INFO o.t.c.cron.Scheduler:127 Waiting at most 10
minutes for termination of running tasks ...
2018-01-31 16:35:21,432 INFO o.t.c.cron.Scheduler:132 Shutdown of all
scheduled tasks completed successfully.
2018-01-31 16:35:21,433 INFO o.t.c.c.ShutdownHook:25 Shutdown finished.
Exiting.
}}}
--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25100#comment:2>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
More information about the tor-bugs
mailing list