[tor-bugs] #25531 [Internal Services]: Add locks in archive.tpo rsync scripts

[Tor Bug Tracker & Wiki]

#25531: Add locks in archive.tpo rsync scripts
---------------------------------------+------------------------
 Reporter:  boklm                      |          Owner:  boklm
     Type:  defect                     |         Status:  closed
 Priority:  Medium                     |      Milestone:
Component:  Internal Services          |        Version:
 Severity:  Normal                     |     Resolution:  fixed
 Keywords:  boklm201803, AffectsTails  |  Actual Points:
Parent ID:                             |         Points:
 Reviewer:                             |        Sponsor:
---------------------------------------+------------------------
Changes (by boklm):

 * status:  assigned => closed
 * resolution:   => fixed


Comment:

 The content of the crontab file was:
 {{{
 # mirror tails livesystem hourly
 0 * * * * rsync -rltgoDq --delete --password-file=/home/torarchive
 /amnesia-rsync-pword.txt rsync://torarchive@rsync.tails.boum.org/tails/
 /srv/archive.torproject.org/htdocs/amnesia.boum.org/ 2>&1 | mail -s "rsync
 on arlgirdense.torproject.org" -E tails-sysadmins at boum.org
 lunar at torproject.org boklm at torproject.org

 # sync tpo/dist to tor package archive hourly.
 0 * * * * rsync -aq
 /srv/static.torproject.org/mirrors/dist.torproject.org/cur/
 /srv/archive.torproject.org/htdocs/tor-package-archive/ 2>&1 | mail -s
 "rsync on arlgirdense.torproject.org" -E boklm at torproject.org

 # sync deb.tpo/torproject.org/pool to tor package archive hourly.
 0 * * * * rsync -aq
 /srv/static.torproject.org/mirrors/deb.torproject.org/cur/torproject.org/pool/
 /srv/archive.torproject.org/htdocs/tor-package-archive/debs/ 2>&1 | mail
 -s "rsync on arlgirdense.torproject.org" -E boklm at torproject.org
 }}}

 I have now updated it to:
 {{{
 # mirror tails livesystem hourly
 0 * * * * flock -n -E 0 /home/torarchive/sync-tails.lock rsync -rltgoDq
 --delete --password-file=/home/torarchive/amnesia-rsync-pword.txt
 rsync://torarchive@rsync.tails.boum.org/tails/
 /srv/archive.torproject.org/htdocs/amnesia.boum.org/ 2>&1 | mail -s "rsync
 on arlgirdense.torproject.org" -E tails-sysadmins at boum.org
 lunar at torproject.org boklm at torproject.org

 # sync tpo/dist to tor package archive hourly.
 0 * * * * flock -n -E 0 /home/torarchive/sync-dist.lock rsync -aq
 /srv/static.torproject.org/mirrors/dist.torproject.org/cur/
 /srv/archive.torproject.org/htdocs/tor-package-archive/ 2>&1 | mail -s
 "rsync on arlgirdense.torproject.org" -E boklm at torproject.org

 # sync deb.tpo/torproject.org/pool to tor package archive hourly.
 0 * * * * flock -n -E 0 /home/torarchive/sync-deb.lock rsync -aq
 /srv/static.torproject.org/mirrors/deb.torproject.org/cur/torproject.org/pool/
 /srv/archive.torproject.org/htdocs/tor-package-archive/debs/ 2>&1 | mail
 -s "rsync on arlgirdense.torproject.org" -E boklm at torproject.org
 }}}

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25531#comment:3>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online