May 2017 - ooni-dev - lists.torproject.org

Turbo OONI report downloader
by David Fifield 15 Jun '17

15 Jun '17

I wrote a program that uses the OONI API to download reports and keep a local directory of reports up to date. It's much faster than the Wget loop I used to use and it finishes quickly when there is nothing new to download. git clone https://www.bamsoftware.com/git/ooni-sync.git For example, lately I've had to download a lot of tcp_connect reports. I run it like this: ooni-sync -xz -directory reports.tcp_connect/ test_name=tcp_connect This command downloads the index of tcp_connect reports and only downloads the ones that are not already downloaded. It compresses the downloaded files with xz. The next time I need to update, I run the same command again, and it only downloads reports that are new since the last time. You can use other query parameters supported by the API, like probe_cc, probe_asn, since, and until. For example: ooni-sync -xz -directory reports.is/ probe_cc=IS since=2017-01-01 ooni-sync -xz -directory reports.as25/ probe_asn=AS25 ooni-sync -xz -directory reports.tor-turkey/ test_name=vanilla_tor probe_cc=TR ooni-sync -xz -directory reports.web_connectivity/ test_name=web_connectivity since=2017-01-01 until=2017-01-02 I prefer to keep all the reports compressed on disk, so I always use the -xz option, but by default reports are saved unmodified.

2 3

Reminder for weekly OONI IRC meeting: Monday 2017-05-29, 16:00 UTC in #ooni
by Vasilis 29 May '17

29 May '17

Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni IRC channel (irc.oftc.net) at 16:00 UTC. Meeting times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20170529T16 In case that you have no IRC client you can join via the: - Web from: https://kiwiirc.com/client/irc.oftc.net/ooni - Slack: https://slack.openobservatory.org/ Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you want to propose any topics: https://pad.riseup.net/p/ooni-irc-pad You can always find previous meeting logs at: http://meetbot.debian.net/ooni/ Cheers, ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0

Lepidopter 1.0.0 is released
by Vasilis 24 May '17

24 May '17

Hello everyone, We are pleased to announce a new release of lepidopter the Raspberry Pi distribution of ooniprobe. ** You can download the ledipoter image here **: Zip archive: https://get.ooni.torproject.org/lepidopter/lepidopter-v1.0.0-armel.img.zip (gpg signature: https://get.ooni.torproject.org/lepidopter/lepidopter-v1.0.0-armel.img.zip.…) Xz archive: https://get.ooni.torproject.org/lepidopter/lepidopter-v1.0.0-armel.img.xz (gpg signature: https://get.ooni.torproject.org/lepidopter/lepidopter-v1.0.0-armel.img.xz.a…) ** Installation instructions ** Upon copying the image to the SD card, plugging it in and connecting the Raspberry Pi to the network, power and waiting some minutes for it to boot up, you should be able to view ooniprobe's graphical user interface by visiting this URL: http://lepidopter.local User documentation and detailed image installation instructions can be found here: https://ooni.torproject.org/install/lepidopter/ The full release changelog can be found here: https://github.com/TheTorProject/lepidopter/releases/tag/v1.0.0 Please let us know if you have encountered any issues during the installation/usage of lepidopter. Enjoy the new release! Cheers, ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0

Reminder for weekly OONI IRC meeting: Monday 2017-05-22, 16:00 UTC in #ooni
by Vasilis 22 May '17

22 May '17

Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni IRC channel (irc.oftc.net) at 16:00 UTC. Meeting times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20170522T16 In case that you have no IRC client you can join via the: - Web from: https://kiwiirc.com/client/irc.oftc.net/ooni - Slack: https://slack.openobservatory.org/ Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you want to propose any topics: https://pad.riseup.net/p/ooni-irc-pad You can always find previous meeting logs at: http://meetbot.debian.net/ooni/ Cheers, ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0

Procedure for reporting false positives
by Khairil Yusof 15 May '17

15 May '17

I'm reviewing the Malaysian Citizen Lab test url report summary and there seem to be false positives (or possible interference that is not visible) The ones that are obviously outdated, and redirected due to domain parking or something I file for removal (usually short lived minor porn sites) Where should I report and track these? http://www.yawa.org on-line gambling site is reported as possible http- diff

3 3

Reminder for weekly OONI IRC meeting: Monday 2017-05-15, 16:00 UTC in #ooni
by Vasilis 15 May '17

15 May '17

Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni IRC channel (irc.oftc.net) at 16:00 UTC. Meeting times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20170515T16 In case that you have no IRC client you can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni or in slack from: https://slack.openobservatory.org/ Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you want to propose any topics: https://pad.riseup.net/p/ooni-irc-pad You can always find previous meeting logs at: http://meetbot.debian.net/ooni/ Cheers, ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0

Bug#861753: ITP: measurement-kit -- Portable C++11 network measurement library
by Iain R. Learmonth 03 May '17

03 May '17

Package: wnpp Severity: wishlist Owner: "Iain R. Learmonth" <irl(a)debian.org> * Package name : measurement-kit Version : 0.6.0 Upstream Author : OONI <ooni-dev(a)lists.torproject.org> * URL : https://github.com/measurement-kit/measurement-kit * License : BSD-2-clause Programming Lang: C++ Description : Portable C++11 network measurement library MeasurementKit is a library that implements open network measurement methodologies (performance, censorship, etc.) and targets mobile platforms (Android and iOS). It is meant to be embedded by third party applications with specific network measurement needs and/or to be used by researchers as a basis to implement novel tools. --- This package will be maintained by the Internet Measurement Packaging Team <pkg-netmeasure-discuss(a)lists.alioth.debian.org>. Thanks, Iain.

2 1