Two major improvements to the Tor Metrics back-end
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello list, as some of you may have noticed, Tor Metrics had some trouble updating its aggregate data lately, and the issues there are by no means completely gone now. But I managed to tweak two of the aggregations that previously took many hours. Here's a graph: https://people.torproject.org/~karsten/volatile/metrics-modules-2016-01-07.p... The green dots at the end are from the latest update. Changes affecting the 70-run-hidserv-stats.sh module: https://gitweb.torproject.org/metrics-web.git/commit/?id=c0f4c76 https://gitweb.torproject.org/metrics-web.git/commit/?id=6054ddd Changes affecting the 80-run-clients-stats.sh module: https://gitweb.torproject.org/metrics-web.git/commit/?id=44acfe5 Boom! All the best, Karsten -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBAgAGBQJWjprFAAoJEJD5dJfVqbCrPT0IALX6dNrL3PK2gbbwAGmm4OBg 4kuz7qFMshTNFp8iT6HB5H9G9/wldgAPanZn+zLlFM0sOBoY1d16RoL2+ay+VKXQ xTeY85tgqMAnbaS2lQcBRZy5j8RXPui94g/ZcKnw9Bg3TpwLFO2+cMXqh1nhMLtb V+Lj0EE+y7qjdtOQO/IbOQzeUr/S9xtze44dRkGlZ0NmeKQsHXaR3m8w8ReIP32k vZekymZkUgbfzYeRoB+jI+3M3l0CF5agwIelhhHlnWwkJ70jPPVrAGX3rhb8X9SX iSNMUJTG62AC3WLqdRkhyY2YJ5OHSMLtpvQwOaOzqSs1yHWylHDVSLTZx+XCQmM= =tvfK -----END PGP SIGNATURE-----
On 07 Jan (18:05:09), Karsten Loesing wrote:
Hello list,
as some of you may have noticed, Tor Metrics had some trouble updating its aggregate data lately, and the issues there are by no means completely gone now.
But I managed to tweak two of the aggregations that previously took many hours. Here's a graph:
https://people.torproject.org/~karsten/volatile/metrics-modules-2016-01-07.p...
The green dots at the end are from the latest update.
I'm not sure to fully understand the green dot. For hidden services, this dot is quite different from the rest so what does it represent exactly? The latest data point? If yes, that changes things quite a bit!! David
The dots are execution times to calculate the stats. So the much-lower dot for hidden service stats is a big improvement! Aaron
On Jan 7, 2016, at 12:25 PM, David Goulet <dgoulet@ev0ke.net> wrote:
On 07 Jan (18:05:09), Karsten Loesing wrote:
Hello list,
as some of you may have noticed, Tor Metrics had some trouble updating its aggregate data lately, and the issues there are by no means completely gone now.
But I managed to tweak two of the aggregations that previously took many hours. Here's a graph:
https://people.torproject.org/~karsten/volatile/metrics-modules-2016-01-07.p...
The green dots at the end are from the latest update.
I'm not sure to fully understand the green dot. For hidden services, this dot is quite different from the rest so what does it represent exactly? The latest data point? If yes, that changes things quite a bit!!
David _______________________________________________ tor-dev mailing list tor-dev@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 07/01/16 21:06, Aaron Johnson wrote:
The dots are execution times to calculate the stats. So the much-lower dot for hidden service stats is a big improvement!
Exactly, thanks for explaining, Aaron. All the best, Karsten
Aaron
On Jan 7, 2016, at 12:25 PM, David Goulet <dgoulet@ev0ke.net> wrote:
On 07 Jan (18:05:09), Karsten Loesing wrote:
Hello list,
as some of you may have noticed, Tor Metrics had some trouble updating its aggregate data lately, and the issues there are by no means completely gone now.
But I managed to tweak two of the aggregations that previously took many hours. Here's a graph:
https://people.torproject.org/~karsten/volatile/metrics-modules-2016-01-07.p...
The green dots at the end are from the latest update.
I'm not sure to fully understand the green dot. For hidden services, this dot is quite different from the rest so what does it represent exactly? The latest data point? If yes, that changes things quite a bit!!
David _______________________________________________ tor-dev mailing list tor-dev@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev
_______________________________________________ tor-dev mailing list tor-dev@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev
-----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBAgAGBQJWj2ufAAoJEJD5dJfVqbCrGBsIALt6SruD6nXqY73EkRvlbmwD /LoqCMw+WlzKFNUfB0n2aN27ZvVwP3FZZUlYd/TwKC6EBUk17lD+zlsYa4QdPODo L4TZkug1KM/ox4jNrbmqwbLraYco6ycbyt18vukbak/DZhQP+vcGhKmamktjT8jH JGg0AVLSRZmbbFh98qwbE/JWF7nXRh1JL0QpEiVGBKiaPhQ2MZwD3uVAtVqz1XMZ HsmNTznfQcaUM47ruJDmGQKjuN/yQDnNrVcc9C25TSrpBxy1qzjGMqitM1xNAwfG 7XytZSS1CuVk0YHLk/ZfYlquDg+8WqOstZAnzOjaHbpOGxjmgwqZR3CTIZKwNCA= =CgiS -----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 07/01/16 18:05, Karsten Loesing wrote:
Hello list,
as some of you may have noticed, Tor Metrics had some trouble updating its aggregate data lately, and the issues there are by no means completely gone now.
But I managed to tweak two of the aggregations that previously took many hours. Here's a graph:
https://people.torproject.org/~karsten/volatile/metrics-modules-2016-01-07.p...
The green dots at the end are from the latest update.
Changes affecting the 70-run-hidserv-stats.sh module:
https://gitweb.torproject.org/metrics-web.git/commit/?id=c0f4c76
https://gitweb.torproject.org/metrics-web.git/commit/?id=6054ddd
Changes affecting the 80-run-clients-stats.sh module:
https://gitweb.torproject.org/metrics-web.git/commit/?id=44acfe5
Here's another improvement, this time to 50-run-legacy-stats.sh which had some runs taking minutes and others taking hours to complete: https://people.torproject.org/~karsten/volatile/metrics-modules-2016-01-07.p... https://gitweb.torproject.org/metrics-web.git/commit/?id=2b3f4b9 As a result I changed Metrics to update its data not only once but twice per day. Let me know if anything produced by Metrics looks unusual. All the best, Karsten -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBAgAGBQJWwh2RAAoJEC3ESO/4X7XBP1IIAKqH/czKeIoFqx1PsIodIozL Yaa1qzzttKNIPaH8TI+OQbY7EsRfXpBFhH10tfu2VuPh8iCQU1oQD554Tu7w8xIR 9UxNt18l10ov2aMPg9zdcZGH+1OWPB7/39anbzjI5aJcqo9vR4b0uMAV7+m1zEO2 Qut3AhPIddDTLm0iF1qKhkOxtmaMXVsB/MG2gZnS4fLmQ0skBkTKzYtZEkveixCY aNmn1ifzHHmst26PARcsJcyP/p//nisU7QN2OIh5oJk/87S4Q6W0jUeaCuudu3hd TE0fzQbp6vomAfVP+JYMuLwQX4ZnP6dNwQlJ8Ph4zRNVREe//1a5nRq/MMUQdps= =7EQS -----END PGP SIGNATURE-----
participants (3)
-
Aaron Johnson -
David Goulet -
Karsten Loesing