March 2017 - ooni-dev - lists.torproject.org

Turbo OONI report downloader
by David Fifield 15 Jun '17

15 Jun '17

I wrote a program that uses the OONI API to download reports and keep a local directory of reports up to date. It's much faster than the Wget loop I used to use and it finishes quickly when there is nothing new to download. git clone https://www.bamsoftware.com/git/ooni-sync.git For example, lately I've had to download a lot of tcp_connect reports. I run it like this: ooni-sync -xz -directory reports.tcp_connect/ test_name=tcp_connect This command downloads the index of tcp_connect reports and only downloads the ones that are not already downloaded. It compresses the downloaded files with xz. The next time I need to update, I run the same command again, and it only downloads reports that are new since the last time. You can use other query parameters supported by the API, like probe_cc, probe_asn, since, and until. For example: ooni-sync -xz -directory reports.is/ probe_cc=IS since=2017-01-01 ooni-sync -xz -directory reports.as25/ probe_asn=AS25 ooni-sync -xz -directory reports.tor-turkey/ test_name=vanilla_tor probe_cc=TR ooni-sync -xz -directory reports.web_connectivity/ test_name=web_connectivity since=2017-01-01 until=2017-01-02 I prefer to keep all the reports compressed on disk, so I always use the -xz option, but by default reports are saved unmodified.

2 3

Procedure for reporting false positives
by Khairil Yusof 15 May '17

15 May '17

I'm reviewing the Malaysian Citizen Lab test url report summary and there seem to be false positives (or possible interference that is not visible) The ones that are obviously outdated, and redirected due to domain parking or something I file for removal (usually short lived minor porn sites) Where should I report and track these? http://www.yawa.org on-line gambling site is reported as possible http- diff

3 3

decommission OONI slice on M-Lab
by Chris Ritzo 27 Mar '17

27 Mar '17

Hi Arturo & OONI dev, I spoke with Arturo about this at the OTF summit last fall, but wanted to confirm before proceeding. It seems OONI is no longer utilizing M-Lab servers since July of last year. Is it safe to begin a decommissioning process for the OONI slice so that it could be available for other experiments? Thanks in advance, Chris Chris Ritzo Senior Technologist, Open Technology Institute @ New America 740 15th Street NW, Suite 900 Washington, DC 20036

1 0

Protocol and app blocking measurement
by Hanna Kreitem 22 Mar '17

22 Mar '17

Hello, Few years ago, Dutch Internet Society released a very good application to test for protocol and communication app blocking, the application have not been maintained for some time now, but is still accessible under open.internet.nl. I think it will be a good idea to integrate the tests this application does into OONI probe, do you think this is possible? The open.internet.nl tests for: "VOIP (SIP and Skype), Whatsapp (XMPP), YouTube, BitTorrent and Spotify. And the related protocols RTSP, DNS, RTP and RTCP." Regards, Hanna.

3 5

OONI tests of WebRTC?
by David Fifield 20 Mar '17

20 Mar '17

What is the feasibility of using OONI to test for blocking of WebRTC? When the Snowflake pluggable transport is deployed, it will be good to know when and how WebRTC connections are blocked. There are some complications. WebRTC is not one protocol but rather a suite of protocols including ICE, DTLS, and SRTP. Different forms of WebRTC will have different fingerprints. What would be a good basic test of WebRTC availability? Perhaps a simulated connection to Google Hangouts.

2 2