Tor metrics: Questionable relays-by-platform accounting
Looking at "Tor metrics - Relays by platform" [0] one could think that the number of "FreeBSD" relays is only slightly lower than the number of "Windows" relays. It also looks like the number of "other" platforms is constantly zero while the number of "Darwin" relays is unclear (but potentially zero as well). Obviously that's incorrect: fk@r500 ~ $sudo -u _tor grep platform /usr/jails/tor-jail/var/db/tor/cached-descriptors | cut -w -f 5 | sort | uniq -c | sort -rn 6662 Linux 555 Windows 286 FreeBSD 83 OpenBSD 25 Darwin 10 NetBSD 4 SunOS 4 ElectroBSD 4 Bitrig 2 DragonFly 1 GNU/kFreeBSD 1 CYGWIN_NT-10.0-WOW Is it possible that the "Tor metrics" count everything but "Linux" and "Windows" as FreeBSD? Fabian [0] https://metrics.torproject.org/platforms.html
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 07/01/16 18:48, Fabian Keil wrote:
Looking at "Tor metrics - Relays by platform" [0] one could think that the number of "FreeBSD" relays is only slightly lower than the number of "Windows" relays.
It also looks like the number of "other" platforms is constantly zero while the number of "Darwin" relays is unclear (but potentially zero as well).
Obviously that's incorrect:
fk@r500 ~ $sudo -u _tor grep platform /usr/jails/tor-jail/var/db/tor/cached-descriptors | cut -w -f 5 | sort | uniq -c | sort -rn 6662 Linux 555 Windows 286 FreeBSD 83 OpenBSD 25 Darwin 10 NetBSD 4 SunOS 4 ElectroBSD 4 Bitrig 2 DragonFly 1 GNU/kFreeBSD 1 CYGWIN_NT-10.0-WOW
Is it possible that the "Tor metrics" count everything but "Linux" and "Windows" as FreeBSD?
Good question. Not exactly: it's counting everything containing "BSD" as "FreeBSD". Ugh. I agree that this is misleading. How about we change the graph legend to "BSD"? (Unfortunately, we cannot distinguish easily between the other BSDs in that graph, because we'd have to re-import the archives since 2007.) Note that your query above is not entirely correct, either. You're overcounting relays publishing more than one descriptor, whereas Metrics only counts descriptors being referenced from the consensus. The latest numbers from Tor metrics are: 2016-01-05,,,,Darwin,,22, 2016-01-05,,,,FreeBSD,,371, 2016-01-05,,,,Linux,,6384, 2016-01-05,,,,Other,,9, 2016-01-05,,,,Windows,,387, See https://metrics.torproject.org/servers-data.html Thanks for reporting. A Trac ticket in component Metrics would have worked, too, but reporting on this list is also fine. All the best, Karsten
Fabian
[0] https://metrics.torproject.org/platforms.html
_______________________________________________ tor-dev mailing list tor-dev@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev
-----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBAgAGBQJWj269AAoJEJD5dJfVqbCrpKgH/07WiUvSOlzOmrULEwkr6Bje tza2QxlKXyQFryrwnToiyQZTOJCtbYitHUzkpa8GkpCxEq7a3Hm+lJGS6WjSOqZ7 XNkrm739e+QuJTB0sbSGPr7vpz7zBFJpt58Y2XAhTg8s4GyPic4R/HQn4QcXTN+4 4N0xUV5ZhQMx10td9QMSaofbxquFe8eYaEdamc0f7YfSZbGisCmH/CqsZsv0VZI/ JKKF4pzTuuQNloUTH4SLuPu5rrG6aWnFlEiUA3Ipu/icjMa78aZAm/um8nToc4Hs aiW1QG+nRgSLzEsdD+KLx4kZKbDWjAHwS7AxGSnGGUMREm1F7GBvc5zu5GW4wI0= =lcjd -----END PGP SIGNATURE-----
Karsten Loesing <karsten@torproject.org> wrote:
On 07/01/16 18:48, Fabian Keil wrote:
Looking at "Tor metrics - Relays by platform" [0] one could think that the number of "FreeBSD" relays is only slightly lower than the number of "Windows" relays.
It also looks like the number of "other" platforms is constantly zero while the number of "Darwin" relays is unclear (but potentially zero as well).
Obviously that's incorrect:
fk@r500 ~ $sudo -u _tor grep platform /usr/jails/tor-jail/var/db/tor/cached-descriptors | cut -w -f 5 | sort | uniq -c | sort -rn 6662 Linux 555 Windows 286 FreeBSD 83 OpenBSD 25 Darwin 10 NetBSD 4 SunOS 4 ElectroBSD 4 Bitrig 2 DragonFly 1 GNU/kFreeBSD 1 CYGWIN_NT-10.0-WOW
Is it possible that the "Tor metrics" count everything but "Linux" and "Windows" as FreeBSD?
Good question. Not exactly: it's counting everything containing "BSD" as "FreeBSD". Ugh. I agree that this is misleading. How about we change the graph legend to "BSD"?
Without further explanation that seems still a bit misleading because "DragonFly" and "Bitrig" are BSDs, too. In fact, "DragonFly" is short for "DragonFly BSD" so even a graph legend like "platforms that contain 'BSD'" would be misleading for someone who does not know the actual platform strings.
(Unfortunately, we cannot distinguish easily between the other BSDs in that graph, because we'd have to re-import the archives since 2007.)
That's indeed unfortunate.
Note that your query above is not entirely correct, either. You're overcounting relays publishing more than one descriptor, whereas Metrics only counts descriptors being referenced from the consensus. The latest numbers from Tor metrics are:
2016-01-05,,,,Darwin,,22, 2016-01-05,,,,FreeBSD,,371, 2016-01-05,,,,Linux,,6384, 2016-01-05,,,,Other,,9, 2016-01-05,,,,Windows,,387,
I see, thanks. Fabian
Is it possible that the "Tor metrics" count everything but "Linux" and "Windows" as FreeBSD?
Good question. Not exactly: it's counting everything containing "BSD" as "FreeBSD". Ugh. I agree that this is misleading. How about we change the graph legend to "BSD"?
+1
Without further explanation that seems still a bit misleading because "DragonFly" and "Bitrig" are BSDs, too. In fact, "DragonFly" is short for "DragonFly BSD" so even a graph legend like "platforms that contain 'BSD'" would be misleading for someone who does not know the actual platform strings.
How about adding Bitrig and DragonFly as well, see: https://trac.torproject.org/projects/tor/ticket/14862#comment:4
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 08/01/16 16:54, Fabian Keil wrote:
Karsten Loesing <karsten@torproject.org> wrote:
On 07/01/16 18:48, Fabian Keil wrote:
Looking at "Tor metrics - Relays by platform" [0] one could think that the number of "FreeBSD" relays is only slightly lower than the number of "Windows" relays.
It also looks like the number of "other" platforms is constantly zero while the number of "Darwin" relays is unclear (but potentially zero as well).
Obviously that's incorrect:
fk@r500 ~ $sudo -u _tor grep platform /usr/jails/tor-jail/var/db/tor/cached-descriptors | cut -w -f 5 | sort | uniq -c | sort -rn 6662 Linux 555 Windows 286 FreeBSD 83 OpenBSD 25 Darwin 10 NetBSD 4 SunOS 4 ElectroBSD 4 Bitrig 2 DragonFly 1 GNU/kFreeBSD 1 CYGWIN_NT-10.0-WOW
Is it possible that the "Tor metrics" count everything but "Linux" and "Windows" as FreeBSD?
Good question. Not exactly: it's counting everything containing "BSD" as "FreeBSD". Ugh. I agree that this is misleading. How about we change the graph legend to "BSD"?
Without further explanation that seems still a bit misleading because "DragonFly" and "Bitrig" are BSDs, too. In fact, "DragonFly" is short for "DragonFly BSD" so even a graph legend like "platforms that contain 'BSD'" would be misleading for someone who does not know the actual platform strings.
Well, it still seems like an improvement over the current situation where we're wrongly classifying non-FreeBSD-BSDs as FreeBSD. Oh, and "platforms that contain 'BSD' wouldn't fit in the legend anyway. Should I proceed with my earlier suggestion to change "FreeBSD" to "BSD" in the legend?
(Unfortunately, we cannot distinguish easily between the other BSDs in that graph, because we'd have to re-import the archives since 2007.)
That's indeed unfortunate.
Only so many battles to fight...
Note that your query above is not entirely correct, either. You're overcounting relays publishing more than one descriptor, whereas Metrics only counts descriptors being referenced from the consensus. The latest numbers from Tor metrics are:
2016-01-05,,,,Darwin,,22, 2016-01-05,,,,FreeBSD,,371, 2016-01-05,,,,Linux,,6384, 2016-01-05,,,,Other,,9, 2016-01-05,,,,Windows,,387,
I see, thanks.
Sure. All the best, Karsten
Fabian
_______________________________________________ tor-dev mailing list tor-dev@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev
-----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBAgAGBQJWj99oAAoJEJD5dJfVqbCrkjcIAJIEBNFMv3yjXLpTVmpcOKdi yIUTItds05GgVDN2Wdb5NbvtJe5HDEZfZMPPHLLcOEYmZejhkoQ7K2Nur5fA+Wcm bhtjkDsBdSCl7aa54DADp1FH8YGTzUJ0fPHqZt6VkAZWAoWE5C8Rqj+2cE4ztCTp C6rLSXh+YH7LOh1RVhUSiOVUG9AA/77TMx6N9o09soW8Rk7G5kA4ryL8VyENZGhe ddMp20Os6HMqmCG5b/j5l7fozWdwtCAmXg94sP/x1hrxzp+aN6NtaEi+y7CU5c0M 0IrRgH/NS4dkkC215IMYuzfzB4iDFYkAL537b/kwp4X23aPxfjOpY5NMkVYM7+o= =jCBT -----END PGP SIGNATURE-----
Karsten Loesing <karsten@torproject.org> wrote:
On 08/01/16 16:54, Fabian Keil wrote:
Karsten Loesing <karsten@torproject.org> wrote:
On 07/01/16 18:48, Fabian Keil wrote:
Looking at "Tor metrics - Relays by platform" [0] one could think that the number of "FreeBSD" relays is only slightly lower than the number of "Windows" relays.
It also looks like the number of "other" platforms is constantly zero while the number of "Darwin" relays is unclear (but potentially zero as well).
Obviously that's incorrect:
fk@r500 ~ $sudo -u _tor grep platform /usr/jails/tor-jail/var/db/tor/cached-descriptors | cut -w -f 5 | sort | uniq -c | sort -rn 6662 Linux 555 Windows 286 FreeBSD 83 OpenBSD 25 Darwin 10 NetBSD 4 SunOS 4 ElectroBSD 4 Bitrig 2 DragonFly 1 GNU/kFreeBSD 1 CYGWIN_NT-10.0-WOW
Is it possible that the "Tor metrics" count everything but "Linux" and "Windows" as FreeBSD?
Good question. Not exactly: it's counting everything containing "BSD" as "FreeBSD". Ugh. I agree that this is misleading. How about we change the graph legend to "BSD"?
Without further explanation that seems still a bit misleading because "DragonFly" and "Bitrig" are BSDs, too. In fact, "DragonFly" is short for "DragonFly BSD" so even a graph legend like "platforms that contain 'BSD'" would be misleading for someone who does not know the actual platform strings.
Well, it still seems like an improvement over the current situation where we're wrongly classifying non-FreeBSD-BSDs as FreeBSD.
Oh, and "platforms that contain 'BSD' wouldn't fit in the legend anyway.
Should I proceed with my earlier suggestion to change "FreeBSD" to "BSD" in the legend?
Yes, please. I agree that it's an improvement. Fabian
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 08/01/16 17:31, Fabian Keil wrote:
Karsten Loesing <karsten@torproject.org> wrote:
Should I proceed with my earlier suggestion to change "FreeBSD" to "BSD" in the legend?
Yes, please. I agree that it's an improvement.
Changed. Thanks for reporting! All the best, Karsten -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQEcBAEBAgAGBQJWkTkTAAoJEJD5dJfVqbCrxHYH/131eOi1cXmqhhFxjZgKWN0f RdVeiEevG+67Uh8nF0Ofn2lawtkAdqbHUA84rdySr9elOhM7lTRJAsLtw01i6uas bRGSlvk3aC0YgigwLdW0A7OtpDiOS+UYNOjgO+5gOwr2QOl3+Ny4L0T+PITM3L8X KbNIfTOLhaOCaslUEcde/+E1H4jjEFQFHV5WyFToiIFcVnUE5jiXr8TbJTGkm/ha S4k+mbCLerZvKmMtVrxxyZ6uELU4ElhisXGmhYgu5Tv0XqLKhxruq5J0OjB944Kf kz+iQ6D/wDuXuSOY29yKgs/4d5VpSuaUJ+VtAbvW6za7GvNG5DEb5DDCOrbqpWQ= =vC3s -----END PGP SIGNATURE-----
participants (3)
-
Fabian Keil -
Karsten Loesing -
nusenu