[metrics-bugs] #25161 [Metrics/CollecTor]: Fix another memory problem with the webstats bulk import

Tor Bug Tracker & Wiki blackhole at torproject.org
Tue Feb 13 15:43:04 UTC 2018

#25161: Fix another memory problem with the webstats bulk import
 Reporter:  karsten            |          Owner:  metrics-team
     Type:  defect             |         Status:  new
 Priority:  Medium             |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:

Comment (by karsten):

 Replying to [comment:4 iwakeh]:
 > Is it really necessary to do the slicing using java?  Assuming such
 imports are limited in number (once a year?) the slices could simply be
 provided by moving the logs to be imported in appropriate folder
 structures and run CollecTor for importing these.

 You mean we should prepare slices manually? How many slices would we need?
 Just one per year?

 > As this is still set to 'new', are you working on this while importing?

 I'm not working on this. I'm waiting for new hardware to arrive that has
 more than 16G RAM. I hope to have that available by next week. Feel free
 to grab the ticket in the meantime!

Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25161#comment:5>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online

More information about the metrics-bugs mailing list