[tor-bugs] #18865 [Metrics/CollecTor]: actively monitor resources like available storage space

[Tor Bug Tracker & Wiki]

#18865: actively monitor resources like available storage space
-------------------------------+------------------------
 Reporter:  iwakeh             |          Owner:  iwakeh
     Type:  enhancement        |         Status:  new
 Priority:  Medium             |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:  ctip               |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+------------------------

Comment (by iwakeh):

 Replying to [comment:1 karsten]:
 > I think I'd rather want us to fix the underlying problem of using
 massive amounts of disk space.  The best way to achieve that is to improve
 how we're producing (xz-compressed) tarballs.  Right now, we're creating
 those tarballs by first writing the uncompressed tarball to disk and then
 compressing it.  Oh, and of course, we have the directories on disk that
 we're creating tarballs from.  I hope we can find a better way.  (If
 there's already a ticket for that, please feel free to paste a link to
 this ticket.)
 >
 Yes, this is fine. Let's use the above list for future discussion here.

 > I also just asked the Tor admins to send me automatic email
 notifications in case the disk is about to run full.  That should be a
 good enough band-aid.
 >
 > Sound okay?
 That's fine, too. (I actually thought that this was the case already ;-)

 Would it make sense to have the "is there enough space check?" immediately
 at the beginning of each
 run? That way in case of a shortage only things like votes and consensus
 etc. could be retrieved, and
 more space consuming tasks could be postponed.
 Thus, avoiding the overfull disk?

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/18865#comment:2>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online