[tor-bugs] #25161 [Metrics/CollecTor]: Fix any memory problem caused by number of log files to be imported by the webstats module

[Tor Bug Tracker & Wiki]

#25161: Fix any memory problem caused by number of log files to be imported by the
webstats module
-------------------------------+-----------------------------------
 Reporter:  karsten            |          Owner:  iwakeh
     Type:  defect             |         Status:  needs_information
 Priority:  Medium             |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+-----------------------------------

Comment (by karsten):

 Replying to [comment:13 iwakeh]:
 > Thanks, for identifying the new issue!
 >
 > I just created a new ticket for this large log issue, #25317.
 >
 > This ticket here should rather handle the import of a number of lesser
 sized logs.

 Okay.

 > In order to see what other work is necessary regarding the import:
 > Could you run the import again without the problematic files and report
 the memory use throughout the import?
 > (That can be achieved by using jconsole and saving the values 'behind'
 the memory graph.)

 Yes, I'll re-run the import without those two files. If you have a
 specific command you want me to run for memory usage monitoring, let me
 know here in the next 15 minutes. Otherwise I'll do my best. :)

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25161#comment:15>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online