[tor-bugs] #32660 [Metrics/Onionoo]: onionoo-backend is killing the ganeti cluster

Wed Dec 4 10:57:12 UTC 2019

#32660: onionoo-backend is killing the ganeti cluster
-----------------------------+------------------------------
 Reporter:  anarcat          |          Owner:  metrics-team
     Type:  defect           |         Status:  new
 Priority:  Medium           |      Milestone:
Component:  Metrics/Onionoo  |        Version:
 Severity:  Normal           |     Resolution:
 Keywords:                   |  Actual Points:
Parent ID:                   |         Points:
 Reviewer:                   |        Sponsor:
-----------------------------+------------------------------

Comment (by karsten):

 Nah, we're not writing 50 GiB per hour. Here are some statistics:

 {{{
 2019-12-04 10:06:30,905 INFO o.t.m.o.cron.Main:216 Document store
     7 list operations performed
     1,859,665 files listed
     1,867,140 files stored
     2.0 GiB stored
     1,874,298 files retrieved
     2.5 GiB retrieved
     0 files removed
 }}}

 I'm currently looking into avoiding some of those writes by comparing file
 digests before writing. Will post results here once I have them.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/32660#comment:5>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online