I wrote a program that uses the OONI API to download reports and keep a
local directory of reports up to date. It's much faster than the Wget
loop I used to use and it finishes quickly when there is nothing new to
download.
git clone https://www.bamsoftware.com/git/ooni-sync.git
For example, lately I've had to download a lot of tcp_connect reports. I
run it like this:
ooni-sync -xz -directory reports.tcp_connect/ test_name=tcp_connect
This command downloads the index of tcp_connect reports and only
downloads the ones that are not already downloaded. It compresses the
downloaded files with xz. The next time I need to update, I run the same
command again, and it only downloads reports that are new since the last
time.
You can use other query parameters supported by the API, like probe_cc,
probe_asn, since, and until. For example:
ooni-sync -xz -directory reports.is/ probe_cc=IS since=2017-01-01
ooni-sync -xz -directory reports.as25/ probe_asn=AS25
ooni-sync -xz -directory reports.tor-turkey/ test_name=vanilla_tor probe_cc=TR
ooni-sync -xz -directory reports.web_connectivity/ test_name=web_connectivity since=2017-01-01 until=2017-01-02
I prefer to keep all the reports compressed on disk, so I always use the
-xz option, but by default reports are saved unmodified.
I'm reviewing the Malaysian Citizen Lab test url report summary and
there seem to be false positives (or possible interference that is not
visible)
The ones that are obviously outdated, and redirected due to domain
parking or something I file for removal (usually short lived minor porn
sites)
Where should I report and track these?
http://www.yawa.org on-line gambling site is reported as possible http-
diff
Hello everyone,
This week's OONI IRC meeting will happen *tomorrow on Tuesday, 28th February at 16:00 UTC* and will be more community-oriented.
Please join us on the #ooni IRC channel (irc.oftc.net) or at https://slack.openobservatory.org (if you're not on IRC).
We'd love to hear your thoughts and suggestions on how to improve research on internet censorship!
Please add topics that you would like to discuss as part of the meeting in this pad: https://pad.riseup.net/p/ooni-community-meeting
If you're not able to join us tomorrow, please feel encouraged to join us on slack or IRC any other day! We are around everyday and happy to engage in discussions with you. :)
Looking forward to connecting with you soon!
All the best,
Maria.
--
Maria Xynou
Research and Partnerships Coordinator
Open Observatory of Network Interference (OONI)
https://ooni.torproject.org/
PGP Key Fingerprint: 2DC8 AFB6 CA11 B552 1081 FBDE 2131 B3BE 70CA 417E
Hi All,
The Measurement and Analysis for Protocols Research Group (MAPRG) is an
Internet Research Task Force (IRTF) research group that is interested in the
kind of measurements that OONI is currently doing.
You can find a brief overview of MAPRG in their charter:
https://datatracker.ietf.org/doc/charter-irtf-maprg/
It would be cool if someone could present OONI at their next meeting, March
26-31 (it's only on one of those days but I'm not sure which). The deadline
is March 3rd.
The full CfP is here:
https://www.ietf.org/mail-archive/web/maprg/current/msg00078.html
Thanks,
Iain.
Hello,
We have recently updated the main (default) backend collector
addresses and web_connectivity test helpers.
Please let us know if you are experiencing any connectivity issues
though this should not be the case.
~Vasilis
--
Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162
Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162