August 2016 - ooni-dev - lists.torproject.org

Procedure for reporting false positives
by Khairil Yusof 15 May '17

15 May '17

I'm reviewing the Malaysian Citizen Lab test url report summary and there seem to be false positives (or possible interference that is not visible) The ones that are obviously outdated, and redirected due to domain parking or something I file for removal (usually short lived minor porn sites) Where should I report and track these? http://www.yawa.org on-line gambling site is reported as possible http- diff

3 3

Reminder for weekly OONI dev gathering Monday 2016-08-29 17:00 UTC (19:00 CEST)
by Arturo Filastò 29 Aug '16

29 Aug '16

Hello Oonitarians, This is a reminder that today there will be the weekly OONI gathering. It will happen as usual on the #ooni channel on irc.oftc.net at 17:00 UTC (19:00 CEST, 13:00 EST, 10:00 PST). You can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni. The tentative schedule for this weeks meeting is: * Discuss the update strategy from 1.x -> 2.x * Set release date for the 2.x series Feel free to add more items as you see fit on the following pad: https://pad.riseup.net/p/ooni-irc-pad Everybody is welcome to join us and bring their questions and feedback. See you later, ~ Arturo

1 0

Reminder for weekly OONI IRC meeting: Monday 2016-08-22, 17:00 UTC in #ooni
by Vasilis 22 Aug '16

22 Aug '16

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni IRC channel (irc.oftc.net) at 17:00 UTC. Event Times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20160822T17 In case that you have no IRC client you can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you want to propose any topics: https://pad.riseup.net/p/ooni-irc-pad ~Vasilis - -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162 -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJXuuKaAAoJEF+/cLHRJgFiulsP/2HQpnUR/gw6Jj2WCm+X61FJ Jbu2gMkSIPks0hHj3yZLGV50dV/tLDTugzgOnPWNa3ME9XlACLvGWHDuFLDBOMcZ 2VrXGF02y6bCdN6B7XWndeaZpIocqRy820P0d+XJYF3pAMjj+nyXQMO4lx4XNIsv Ku8RkZirAvefd9dLjgZR8yYM6GkEClSZvFyNXQfSt6tYvxJ4oWl5BN778H6sjxob El9Oj5r+SWRgoc5mf/9i+n56bmChSJ56gpn/6r1Wf9sGfQGtS1mfDPuESpuV4ATn fIbz+BWEHRbEnM8O7h/nK5iNb5ZL1DxhjTCbGJyqG0+I3F0oOiFWq8HXJzozMRQm iAtk0UmVX1HwRQ7WeggdJQ4FG+LelQSeN8U1/HC5+ikbi4b1Y+cP6PctyP5+/25i 90KpGcizXkBZSu3feSSIYL8JhjSdRWLFt4INNCCnJSHmBCtIoNR/Hd4yM4o+vzPF UCnU5tekBGfF+/Z1LnJFWFaDaLscfv6HMx+hJtBWUbzhCiQB8U3jSBbStt7zlorR AK4PeyIULb4XZ7odPnJktXi3dVOHNXSbD6jwOO8Dxe6C26bRcYxGjzzFq9449mpt v2OJ7w6oPGwwK14AR68F3jbz3NmqIIy/aPLFmELr/nq3OnjdIvW/cO7JyMdbnTgI e35as+JLk5YPySGUsjY4 =Uwzp -----END PGP SIGNATURE-----

1 0

Reminder for weekly OONI IRC meeting: Monday 2016-08-15, 17:00 UTC in #ooni
by Vasilis 15 Aug '16

15 Aug '16

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni IRC channel (irc.oftc.net) at 17:00 UTC. Event Times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20160815T17 In case that you have no IRC client you can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you want to propose any topics: https://pad.riseup.net/p/ooni-irc-pad ~Vasilis - -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162 -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJXsef6AAoJEF+/cLHRJgFiABsQAJN6RmybKzR4nU89E6MsSUDq fRf2AXeAWNxJtRge8COz23N0zWxNNhl/jw+L7hVPPaZOg0oMTEfyCaseFu/JmwGg bGGyUH1rf+tNNjAYEO7lijiIkHzzUvyba77JqyKTVgm4fJeGnsQRTleQJt+pUKzY jBVBmyw9rWzavxINkhAleKkN0KkVSiC0JruhB8H6l88UyFXf9fUvI3uLan/H268F 8dBhunTUWEsECOmGpptblqEpixzsFQPevoVBK8OMAdpSBytlSci7fNWj0CoZef0O 200TV0r88h77xQT0YWja9WcaIrT0vpI4mnyXIxcz/ssPG37S6Zg0VuYAsX0LNRTt 9ddFNWB+uZbp/a+1fhQJoz4yCUF1EbOvWKrJcIrjxgZbwZj8SEklSmrts+qI0ilL s/L5tXFXK1OdC6Gwl+0TVEw9sDZByp9XrPFI2tquUFa9zhBejPzJESQ7D6RnDnW0 qWR/JO6BFxMzGCvt/M9cBtq7mJydFzG0UuTzKp/W63nUa8aaEcofIyU4oXdZ39ph NPqBE+M1JW83lcHV7FVeyBJDr9VnLgHu7ejfHBCNYsFb/GjEHO9bowLpL7u+Xiju 1Ag2nMR3ASf5k9incMwWZne0riDuuSsS/PJ4qIdgHtuIAADEkkbNxjGIBzfE419T ZMPMChpRVrkXF4Mh9FYE =VsX7 -----END PGP SIGNATURE-----

1 0

Call for alpha testing of ooniprobe 2.0.0 series
by Arturo Filastò 11 Aug '16

11 Aug '16

Hello Oonitarians! We are pleased to announce the public alpha testing of ooniprobe 2.0.0! Amongst other things this prospect new release adds support for a web based GUI, allowing you to trigger measurements and directly inspect the results of them. It’s mainly designed to be used from raspberry pi based deployments, but you can also use it to control ooniprobe on desktop. If you want to jump straight into testing it here is what you have to do: 1) Install the standard requirements for ooniprobe. On debian this can be done with: apt-get install -y build-essential libdumbnet-dev libpcap-dev libgeoip-dev libffi-dev python-dev python-pip libssl-dev 2.a) It’s advisable you create a virtual python environment for testing this release and that you don’t install it system wide. If you don’t want to do this just skip all the 2.x steps. You can get python-virtualenv on debian with: apt-get install python-virtualenv 2.b) Then you should create the virtualenv for testing ooniprobe alpha with: virtualenv ~/venv-ooniprobe-agent-alpha/ Every time you want to run ooniprobe-agent from the virtualenv remember to first do: source ~/venv-ooniprobe-agent-alpha/bin/activate 3) Install the alpha build with pip by doing: pip install https://github.com/TheTorProject/ooni-probe/releases/download/v2.0.0-alpha.… (this is the signature file for the package: https://github.com/TheTorProject/ooni-probe/releases/download/v2.0.0-alpha.…) 4) Then start the ooniprobe-agent as a system daemon by running: ooniprobe-agent start 5) You can connect to it by visiting http://localhost:8842/ and you will be greeted by the setup wizard. You can also find these instructions on the release tag on github: https://github.com/TheTorProject/ooni-probe/releases/tag/v2.0.0-alpha.2 Some of the major changes in this version are: * A new deck format that amongst other things supports specifying scheduling information with a cron-like syntax: https://github.com/TheTorProject/ooni-probe/issues/571 * New system daemon called ooniprobe-agent that is responsible for exposing the web UI, but also scheduling recurring operations, such as the update of inputs, running of the period decks, etc.: https://github.com/TheTorProject/ooni-probe/issues/576 * Local reports are now also written only in JSON: https://github.com/TheTorProject/ooni-probe/issues/557 * Informed consent procedure will appear when you first run either ooniprobe or ooniprobe-agent. This will inform you of the risks associated with running ooniprobe. Some important changes are: * oonideckgen is now deprecated, the executable is still there, but it always generates the same deck. This is because the new more powerful deck format supports parameters inside of it, so there is no need to update the paths to the inputs when they get updated. * ooniresources is also deprecated and the executable actually does nothing, but is left there to avoid breaking scripts that are relying on it. It will be removed though in future versions entirely. * ooniprobe by default will not allow you to run measurements unless you read through the risks document. Please report any bugs you may find on github at the following address: https://github.com/TheTorProject/ooni-probe/issues/new?title=[2.0.0%20relea… Have fun! ~ Arturo

1 0

Reminder for weekly OONI dev gathering Monday 2016-08-08 17:00 UTC (19:00 CEST)
by Arturo Filastò 08 Aug '16

08 Aug '16

Hello Oonitarians, This is a reminder that today there will be the weekly OONI gathering. It will happen as usual on the #ooni channel on irc.oftc.net at 17:00 UTC (19:00 CEST, 13:00 EST, 10:00 PST). You can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni. The tentative schedule for this weeks meeting is: * Announce the public alpha testing phase for the ooni web UI Feel free to add more items as you see fit on the following pad: https://pad.riseup.net/p/ooni-irc-pad Everybody is welcome to join us and bring their questions and feedback. See you later, ~ Arturo

1 0

Understanding how client resolver is determined
by Khairil Yusof 03 Aug '16

03 Aug '16

yaml webconnectivity log: accessible: false agent: redirect blocking: dns body_length_match: false body_proportion: 0.09658116667249887 client_resolver: 202.188.1.6 control: dns: addrs: [sarawakreport.org, 104.25.9.14, 104.25.8.14] Questions. What is client_resolver how does it determine that it's 202.188.1.6, in another yesterday it's 202.188.1.7 (https://explorer.ooni.torproject.or g/measurement/20160802T205955Z_AS4788_3omRbM1JA9BYIMF5O5uiKEsdmUqy4kdun nKn7exzBlM2ebboDh?input=http:%2F%2Fwww.sarawakreport.org) Both of which I can't use to resolve addresses from the same network. The system resolver in this case is 1.9.1.9. 202.188.1.5 would also work but is not used in the report. However the http_request does use the correct tampered address, so I'm curious as to how it could use a resolver that I can't use to lookup from the same network.

2 2

Reminder for weekly OONI dev gathering Monday 2016-08-01 17:00 UTC (19:00 CEST)
by Arturo Filastò 01 Aug '16

01 Aug '16

Hello Oonitarians, This is a reminder that today there will be the weekly OONI gathering. It will happen as usual on the #ooni channel on irc.oftc.net at 17:00 UTC (19:00 CEST, 13:00 EST, 10:00 PST). You can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni. The tentative schedule for this weeks meeting is: * Discuss the Measurement-Kit scripting engine Feel free to add more items as you see fit on the following pad: https://pad.riseup.net/p/ooni-irc-pad Everybody is welcome to join us and bring their questions and feedback. See you later, ~ Arturo

1 0