[metrics-team] Help explain this graph (why correct client IP addresses don't seem to change bridge users)

Wed Jan 27 19:45:29 UTC 2016

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 22/01/16 22:16, David Fifield wrote:
> Because of the way the meek pluggable transport works, it used to
> be that the server plugin reported the wrong client IP addresses to
> tor through the extended ORPort: it reported the CDN IP address,
> not the client IP address. As a result it appeared that nearly 100%
> of meek users were in the United States. In ticket #13171, we
> changed that to report the correct client IP addresses, and as
> expected, we see a change in dirreq-v3-reqs that now report many
> countries.
> 
> However the change doesn't appear to be reflected in this graph,
> which shows meek users, us bridge users, and cn bridge users. Since
> deploying the patch for #13171, the number of cn users stayed
> pretty flat. (The increase near the end of the graph probably has
> more to do with relaxed rate limiting than with #13171.)
> 
> https://bugs.torproject.org/13171#comment:14

Responded on the ticket and filed a new ticket for the bug in Metrics:

https://trac.torproject.org/projects/tor/ticket/18167

Thanks for bringing this to my attention.  I would have missed it
otherwise.  If there are similar bugs, please do let me know.

All the best,
Karsten

> This is surprising to me because cn accounts for about 12% of the
> mass in the dirreq-v3-reqs lines of the meek bridges. A sample is
> below; notice "us=4848,cn=2408" are the first two entries.
> 
> 
> https://collector.torproject.org/recent/bridge-descriptors/extra-infos/2016-01-22-19-09-04-extra-infos
>
>  @type bridge-extra-info 1.3 extra-info starman
> AA033EEB61601B2B7312D89B62AAA23DC3ED8A34 master-key-ed25519
> wDyfZwRwefOAn2P6xs/Orc93ODRtPjchBKWQ6gEuiqM published 2016-01-22
> 18:38:57 write-history 2016-01-22 16:56:07 (14400 s)
> 31475360768,23558500352,26828833792,28492759040,25694834688,33447501824
>
> 
read-history 2016-01-22 16:56:07 (14400 s)
29337951232,21400456192,24830735360,26037506048,23493612544,31104707584
> dirreq-write-history 2016-01-22 16:56:07 (14400 s)
> 2182542336,2187110400,2027403264,2487760896,2224635904,2395241472 
> dirreq-read-history 2016-01-22 16:56:07 (14400 s)
> 55204864,53849088,54896640,58649600,64333824,74096640 
> geoip-db-digest 6346E26E2BC96F8511588CE2695E9B0339A75D32 
> geoip6-db-digest 43CCB43DBC653D8CC16396A882C5F116A6004F0C 
> dirreq-stats-end 2016-01-22 09:45:02 (86400 s) dirreq-v3-ips
> us=1304,cn=824,ru=568,de=448,gb=216,ir=176,br=144,fr=136,in=136,it=136,au=112,mx=112,tr=104,ca=80,id=72,es=64,nl=56,ua=56,za=56,my=48,pl=48,sa=48,at=40,by=40,ch=40,eg=40,ar=32,kr=32,be=24,co=24,cz=24,fi=24,ie=24,kz=24,ng=24,ph=24,ro=24,se=24,ve=24,vn=24,ye=24,ae=16,bd=16,cl=16,dz=16,ec=16,gh=16,hk=16,il=16,jo=16,jp=16,ke=16,kw=16,lb=16,ma=16,nz=16,om=16,pr=16,sk=16,th=16,tw=16,am=8,ao=8,az=8,ba=8,bg=8,bh=8,bo=8,bt=8,cd=8,ci=8,cm=8,cr=8,cv=8,dk=8,do=8,ee=8,et=8,fj=8,gp=8,gq=8,gr=8,gt=8,hr=8,hu=8,iq=8,jm=8,km=8,lt=8,lu=8,lv=8,ly=8,md=8,mn=8,mt=8,mu=8,ni=8,no=8,np=8,pa=8,pe=8,pk=8,ps=8,pt=8,qa=8,sd=8,sg=8,sn=8,so=8,sv=8,sy=8,tj=8,tm=8,tn=8,tt=8,ug=8,uy=8,uz=8,vg=8,zm=8
>
> 
dirreq-v3-reqs
us=4848,cn=2408,ru=1664,de=1496,gb=928,fr=568,mx=528,ir=520,in=480,br=472,it=448,ca=360,au=328,tr=320,nl=232,ua=224,es=192,ch=176,id=168,sa=144,eg=136,za=136,my=128,kr=120,pl=120,ar=104,vn=104,fi=96,ph=96,at=88,by=88,kz=88,be=80,co=80,se=80,ae=72,cl=72,cz=72,ro=64,ec=56,ng=56,pt=56,uz=56,dz=48,ie=48,il=48,ma=48,tn=48,ye=48,bd=40,hk=40,kw=40,nz=40,th=40,tm=40,ve=40,bg=32,dk=32,do=32,gh=32,gt=32,jo=32,jp=32,no=32,pr=32,tw=32,bo=24,gr=24,iq=24,ke=24,lb=24,lu=24,ly=24,pe=24,qa=24,sk=24,so=24,az=16,bh=16,cr=16,hu=16,lv=16,md=16,mt=16,om=16,pa=16,ps=16,sd=16,sn=16,sv=16,sy=16,tt=16,ug=16,am=8,ao=8,ba=8,bt=8,cd=8,ci=8,cm=8,cv=8,ee=8,et=8,fj=8,gp=8,gq=8,hr=8,jm=8,km=8,lt=8,mn=8,mu=8,ni=8,np=8,pk=8,sg=8,tj=8,uy=8,vg=8,zm=8
> dirreq-v3-resp
> ok=19744,not-enough-sigs=0,unavailable=0,not-found=0,not-modified=5520,busy=0
>
> 
dirreq-v3-direct-dl complete=0,timeout=0,running=0
> dirreq-v3-tunneled-dl
> complete=16796,timeout=2924,running=20,min=2032,d1=15749,d2=32230,q1=40496,d3=49072,d4=67539,md=85099,d6=102365,d7=121084,q3=132618,d8=146433,d9=183340,max=1013024
>
> 
transport meek
> bridge-stats-end 2016-01-22 09:45:10 (86400 s) bridge-ips
> us=1872,cn=880,ru=808,de=648,gb=312,it=216,ir=208,br=200,fr=192,in=192,id=168,tr=144,au=128,mx=128,es=104,ca=88,nl=88,za=80,pl=72,my=64,sa=64,ua=64,ch=56,ar=48,at=48,eg=48,by=40,kr=40,sk=40,tw=40,be=32,ke=32,kz=32,ro=32,vn=32,ye=32,bd=24,cl=24,co=24,cz=24,ec=24,fi=24,ie=24,il=24,ma=24,ng=24,nz=24,om=24,ph=24,pr=24,se=24,ve=24,ae=16,bg=16,dz=16,gh=16,hk=16,jo=16,jp=16,kw=16,lb=16,no=16,sg=16,sn=16,th=16,tn=16,ug=16,am=8,ao=8,az=8,ba=8,bh=8,bo=8,bt=8,cd=8,ci=8,cm=8,cr=8,cv=8,dk=8,do=8,ee=8,et=8,fj=8,gp=8,gq=8,gr=8,gt=8,hr=8,hu=8,iq=8,jm=8,km=8,lt=8,lu=8,lv=8,ly=8,md=8,mn=8,mt=8,mu=8,ni=8,np=8,pa=8,pe=8,pk=8,ps=8,pt=8,qa=8,sd=8,so=8,sv=8,sy=8,tj=8,tm=8,tt=8,uy=8,uz=8,vg=8,zm=8
>
> 
bridge-ip-versions v4=7784,v6=40
> bridge-ip-transports <OR>=8,meek=7824 router-digest-sha256
> R3gRpFb23S4oyaVO0Xb4RXSxXrJ7t0+jM6pgUm58RNM router-digest
> 1147D55D734ADFA8F493C403B933EDEC4E5B0659 
> _______________________________________________ metrics-team
> mailing list metrics-team at lists.torproject.org 
> https://lists.torproject.org/cgi-bin/mailman/listinfo/metrics-team
> 

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - http://gpgtools.org

iQEcBAEBAgAGBQJWqR5ZAAoJEJD5dJfVqbCrojoH/2X+5LnDIfjARVqY9o2Dgxb6
j/U7b5v3jRkm0yeZSXk9I4RCLeZ6rRQJESgTeLiyPLMe6nMZYv+8am4IaR9KaI8i
1f0eBocpGklv6YdCQAzkJr/sMpUkGyUBrWYfXeiHws/uvuMMEMDfH2XB2KHY1Lui
BnMzP8Jzew0ipzLziH0+/ezRetqIOY/zfy+sbJhWwO6AtmP/nBcmlKNR4vOu6Zly
tJYP9Pz7QdNrxjgK9v15Tpqpnn1IAkNb51egMJIrzsiOsk3JjvTTtI4SjzkyiH2H
zMU1nImHYpGSjb3Xh8T/8YB57hkZZq4EoSYLpFPZ7Xy8mSAod48ZZiUb4V6n4wg=
=QMFy
-----END PGP SIGNATURE-----