Help us get recent cached consensuses from your relay
Hi, Due to a recent CollecTor outage, we are missing consensuses from 2018-08-04 19:00 to 2018-08-05 17:00 UTC. We can recover about 16 of the missing consensuses, but we are still looking for the older 7. If your relay is: * running 0.3.1.1-alpha or later, and it is only using gzip compression, * or it is running on Windows, then it might have some of these consensuses in the diff-cache directory in its DataDirectory (or CacheDirectory). You can run the following command to count the cached consensuses: $ cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c 66 document-type consensus 190 document-type consensus-diff If you have more than 68 consensus files, please take a copy of the diff-cache directory, and let us know where we can download it. Your relay will delete 2 old consensuses every hour. If you’re reading this email N hours after it was sent, your relay needs 68 + 2*N consensuses. T -- teor Please reply @torproject.org New subkeys 1 July 2018 PGP C855 6CED 5D90 A0C5 29F6 4D43 450C BA7F 968F 094B ----------------------------------------------------------------------
On 6 August 2018 at 11:00, teor <teor@riseup.net> wrote:
Hi,
Due to a recent CollecTor outage, we are missing consensuses from 2018-08-04 19:00 to 2018-08-05 17:00 UTC. We can recover about 16 of the missing consensuses, but we are still looking for the older 7.
If your relay is: * running 0.3.1.1-alpha or later, and it is only using gzip compression, * or it is running on Windows, then it might have some of these consensuses in the diff-cache directory in its DataDirectory (or CacheDirectory).
You can run the following command to count the cached consensuses:
$ cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
66 document-type consensus 190 document-type consensus-diff
If you have more than 68 consensus files, please take a copy of the diff-cache directory, and let us know where we can download it.
I have 86, starting from Aug 4 11:24 on my fedora relay running 0.3.1.10 (yeah for diversity of distros :) ) I have put it on http://fasmz.org/~pterjan/diff-cache.tar.xz
Your relay will delete 2 old consensuses every hour. If you’re reading this email N hours after it was sent, your relay needs 68 + 2*N consensuses.
T
-- teor
Please reply @torproject.org New subkeys 1 July 2018 PGP C855 6CED 5D90 A0C5 29F6 4D43 450C BA7F 968F 094B ----------------------------------------------------------------------
_______________________________________________ tor-relays mailing list tor-relays@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
teor:
cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
On 6 Aug 2018, at 21:01, Lluís <2015.msl@gmail.com> wrote:
Is it safe to publish the ouput of the command here ?
Yes. Your relay publishes these cached documents, so the content and number of documents in the cache is public information. We’re now looking for a few more operators who have more than: 70 document-type consensus So that we have a few redundant copies. T
Hi everyone: Here is my output, I understand it's not the kind of relay you are looking for: # cat * | grep -a ^document-type | sort | uniq -c 56 document-type consensus 200 document-type consensus-diff Lluís Barcelona teor:
teor:
cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
On 6 Aug 2018, at 21:01, Lluís <2015.msl@gmail.com> wrote:
Is it safe to publish the ouput of the command here ?
Yes.
Your relay publishes these cached documents, so the content and number of documents in the cache is public information.
We’re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
T
_______________________________________________ tor-relays mailing list tor-relays@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
On Mon, Aug 06, 2018 at 09:07:32PM +1000, teor wrote:
We???re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
moria1 reported 86. I've put the tarball here: https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2 --Roger
On 2018-08-06 16:41, Roger Dingledine wrote:
On Mon, Aug 06, 2018 at 09:07:32PM +1000, teor wrote:
We???re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
moria1 reported 86. I've put the tarball here:
https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2 Thanks, everyone! We have enough consensus copies to fill the gap. We already inflated them and imported them into CollecTor:
https://metrics.torproject.org/collector/recent/relay-descriptors/consensuse... It might take a short while for Onionoo and Tor Metrics to notice, but on CollecTor we're not missing any data anymore. Thanks, teor, for starting this call for help, and thanks, everyone, for sending their descriptors. Yay! All the best, Karsten
Sorry I didn't get a chance to do this sooner - I've been out of the office without access to the box. My consensus history is lower than 68. Regards. On Mon, Aug 6, 2018 at 3:39 PM Karsten Loesing <karsten@torproject.org> wrote:
On 2018-08-06 16:41, Roger Dingledine wrote:
On Mon, Aug 06, 2018 at 09:07:32PM +1000, teor wrote:
We???re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
moria1 reported 86. I've put the tarball here:
https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2 Thanks, everyone! We have enough consensus copies to fill the gap. We already inflated them and imported them into CollecTor:
https://metrics.torproject.org/collector/recent/relay-descriptors/consensuse...
It might take a short while for Onionoo and Tor Metrics to notice, but on CollecTor we're not missing any data anymore.
Thanks, teor, for starting this call for help, and thanks, everyone, for sending their descriptors. Yay!
All the best, Karsten
_______________________________________________ tor-relays mailing list tor-relays@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
-- Matthew Glennon matthew@glennon.online PGP Signing Available Upon Request https://keybase.io/crazysane
Hi everyone, I wouldn't get out of topic, but the link to "freehaven.net" triggered my curiosity. I took a look to the WEB site but there are no instructions about using it or how to set up a "servnet". However, I can download files from it like the one that triggered the question: https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2 Is freehaven.net working ? Cheers ! Lluis Spain Roger Dingledine:
On Mon, Aug 06, 2018 at 09:07:32PM +1000, teor wrote:
We???re now looking for a few more operators who have more than:
70 document-type consensus
So that we have a few redundant copies.
moria1 reported 86. I've put the tarball here:
https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2
--Roger
_______________________________________________ tor-relays mailing list tor-relays@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
On Wed, Aug 08, 2018 at 09:00:00AM +0000, Lluís wrote:
I wouldn't get out of topic, but the link to "freehaven.net" triggered my curiosity. I took a look to the WEB site but there are no instructions about using it or how to set up a "servnet". However, I can download files from it like the one that triggered the question:
https://freehaven.net/~arma/2018-08-06-diff-cache.tar.bz2
Is freehaven.net working ?
freehaven.net is a website, and it's working like any other website. The project called Free Haven never got finished, because of the hard research questions described on the front page: https://www.freehaven.net/ Hope that helps, --Roger
On Mon, 6 Aug 2018 20:00:09 +1000 teor <teor@riseup.net> wrote:
Hi,
Due to a recent CollecTor outage, we are missing consensuses from 2018-08-04 19:00 to 2018-08-05 17:00 UTC. We can recover about 16 of the missing consensuses, but we are still looking for the older 7.
If your relay is: * running 0.3.1.1-alpha or later, and it is only using gzip compression, * or it is running on Windows, then it might have some of these consensuses in the diff-cache directory in its DataDirectory (or CacheDirectory).
You can run the following command to count the cached consensuses:
$ cd diff-cache; cat * | grep -a ^document-type | sort | uniq -c
66 document-type consensus 190 document-type consensus-diff
If you have more than 68 consensus files, please take a copy of the diff-cache directory, and let us know where we can download it.
Your relay will delete 2 old consensuses every hour. If you’re reading this email N hours after it was sent, your relay needs 68 + 2*N consensuses.
T
-- teor
Please reply @torproject.org New subkeys 1 July 2018 PGP C855 6CED 5D90 A0C5 29F6 4D43 450C BA7F 968F 094B ----------------------------------------------------------------------
Although current diff-cache of all my relays don't have the required info, I do daily backups of whole /var/lib/tor, so here is a link to archive which contains diff-cache from 05.08.2018 00:00 UTC and 06.08.2018 00:00 UTC backups: https://demfloro.ru/static/diff-caches.tar.xz (145 Mb)
participants (7)
-
Dmitrii Tcvetkov -
Karsten Loesing -
Lluís -
Matthew Glennon -
Pascal Terjan -
Roger Dingledine -
teor