February 2017 - ooni-dev - lists.torproject.org

Turbo OONI report downloader
by David Fifield 15 Jun '17

15 Jun '17

I wrote a program that uses the OONI API to download reports and keep a local directory of reports up to date. It's much faster than the Wget loop I used to use and it finishes quickly when there is nothing new to download. git clone https://www.bamsoftware.com/git/ooni-sync.git For example, lately I've had to download a lot of tcp_connect reports. I run it like this: ooni-sync -xz -directory reports.tcp_connect/ test_name=tcp_connect This command downloads the index of tcp_connect reports and only downloads the ones that are not already downloaded. It compresses the downloaded files with xz. The next time I need to update, I run the same command again, and it only downloads reports that are new since the last time. You can use other query parameters supported by the API, like probe_cc, probe_asn, since, and until. For example: ooni-sync -xz -directory reports.is/ probe_cc=IS since=2017-01-01 ooni-sync -xz -directory reports.as25/ probe_asn=AS25 ooni-sync -xz -directory reports.tor-turkey/ test_name=vanilla_tor probe_cc=TR ooni-sync -xz -directory reports.web_connectivity/ test_name=web_connectivity since=2017-01-01 until=2017-01-02 I prefer to keep all the reports compressed on disk, so I always use the -xz option, but by default reports are saved unmodified.

2 3

Procedure for reporting false positives
by Khairil Yusof 15 May '17

15 May '17

I'm reviewing the Malaysian Citizen Lab test url report summary and there seem to be false positives (or possible interference that is not visible) The ones that are obviously outdated, and redirected due to domain parking or something I file for removal (usually short lived minor porn sites) Where should I report and track these? http://www.yawa.org on-line gambling site is reported as possible http- diff

3 3

Weekly OONI IRC meeting: Tuesday 2017-02-28, 16:00 UTC in #ooni
by Maria Xynou 27 Feb '17

27 Feb '17

Hello everyone, This week's OONI IRC meeting will happen *tomorrow on Tuesday, 28th February at 16:00 UTC* and will be more community-oriented. Please join us on the #ooni IRC channel (irc.oftc.net) or at https://slack.openobservatory.org (if you're not on IRC). We'd love to hear your thoughts and suggestions on how to improve research on internet censorship! Please add topics that you would like to discuss as part of the meeting in this pad: https://pad.riseup.net/p/ooni-community-meeting If you're not able to join us tomorrow, please feel encouraged to join us on slack or IRC any other day! We are around everyday and happy to engage in discussions with you. :) Looking forward to connecting with you soon! All the best, Maria. -- Maria Xynou Research and Partnerships Coordinator Open Observatory of Network Interference (OONI) https://ooni.torproject.org/ PGP Key Fingerprint: 2DC8 AFB6 CA11 B552 1081 FBDE 2131 B3BE 70CA 417E

1 0

Someone to present OONI at MAPRG, IETF-98, Chicago?
by Iain R. Learmonth 24 Feb '17

24 Feb '17

Hi All, The Measurement and Analysis for Protocols Research Group (MAPRG) is an Internet Research Task Force (IRTF) research group that is interested in the kind of measurements that OONI is currently doing. You can find a brief overview of MAPRG in their charter: https://datatracker.ietf.org/doc/charter-irtf-maprg/ It would be cool if someone could present OONI at their next meeting, March 26-31 (it's only on one of those days but I'm not sure which). The deadline is March 3rd. The full CfP is here: https://www.ietf.org/mail-archive/web/maprg/current/msg00078.html Thanks, Iain.

1 0

Reminder for weekly OONI IRC meeting: Monday 2017-02-20, 16:00 UTC in #ooni
by Vasilis 20 Feb '17

20 Feb '17

Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni IRC channel (irc.oftc.net) at 16:00 UTC. *Watch out if you live in an area affected by the daylight saving time!* Meeting times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20170220T16 In case that you have no IRC client you can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you want to propose any topics: https://pad.riseup.net/p/ooni-irc-pad You can always find previous meeting logs at: http://meetbot.debian.net/ooni/ ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0

Reminder for weekly OONI IRC meeting: Monday 2017-02-13, 16:00 UTC in #ooni
by Vasilis 13 Feb '17

13 Feb '17

Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni IRC channel (irc.oftc.net) at 16:00 UTC. *Watch out if you live in an area affected by the daylight saving time!* Meeting times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20170213T16 In case that you have no IRC client you can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you want to propose any topics: https://pad.riseup.net/p/ooni-irc-pad You can always find previous meeting logs at: http://meetbot.debian.net/ooni/ ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0

Grammar error in the Android app
by Yassine Imounachen 10 Feb '17

10 Feb '17

Hi. The word selected in the screenshot attached should be "measure" instead of "measurement".

2 1

Reminder for weekly OONI IRC meeting: Monday 2017-02-06, 16:00 UTC in #ooni
by Vasilis 06 Feb '17

06 Feb '17

Hello, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni IRC channel (irc.oftc.net) at 16:00 UTC. *Watch out if you live in an area affected by the daylight saving time!* Meeting times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20170206T16 In case that you have no IRC client you can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you want to propose any topics: https://pad.riseup.net/p/ooni-irc-pad You can always find previous meeting logs here: http://meetbot.debian.net/ooni/ ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0

Collector and web_connectivity test helper addresses change.
by Vasilis 02 Feb '17

02 Feb '17

Hello, We have recently updated the main (default) backend collector addresses and web_connectivity test helpers. Please let us know if you are experiencing any connectivity issues though this should not be the case. ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0