[tor-bugs] #19249 [Metrics/Onionoo]: Onionoo server runs out of memory when importing a full month of data

[Tor Bug Tracker & Wiki]

#19249: Onionoo server runs out of memory when importing a full month of data
-----------------------------+---------------------
 Reporter:  karsten          |          Owner:
     Type:  defect           |         Status:  new
 Priority:  Medium           |      Milestone:
Component:  Metrics/Onionoo  |        Version:
 Severity:  Normal           |     Resolution:
 Keywords:                   |  Actual Points:
Parent ID:                   |         Points:
 Reviewer:                   |        Sponsor:
-----------------------------+---------------------

Comment (by iwakeh):

 OK, 8g might work, too.
 I can only guesstimate how much additional memory the full run needs. And,
 June data is not yet a full month worth in addition.

 Regarding cpu usage:
 I noticed that the import usually busies about two cores. The jvm uses
 parallelization a lot.
 So, when all cores start getting busy for too long the problem has
 started. At least that's what I observed on a machine with more than four
 cores.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/19249#comment:5>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online