April 2014 - ooni-dev - lists.torproject.org

Tinkering with M-Lab servers.
by Nathan Wilcox 30 Apr '14

30 Apr '14

Hey Oonitarians, We wanted to start checking out the deployment process in earnest for Ooni. We already should have ssh access to the test slices, such as mlab1.nuq0t.measurement-lab.org. Does anyone mind if we log in and tinker with that slice over the next couple of weeks? We're planning on running through the process (probably by using ooni-support [1] ) in a few hours unless someone raises an alarm. Speaking of which, does either M-Lab or Ooni have any kind of operations ticketing system where we should track this kind of stuff, or shall we just stick to email for now? -- Nathan Wilcox Least Authoritarian

3 3

OONI Debian packages
by jony-port＠bitmessage.ch 02 Apr '14

02 Apr '14

Hi, Which spec is being used to create Debian packages for OONI?

2 1

Some good tickets to start hacking on OONI
by Arturo Filastò 02 Apr '14

02 Apr '14

Here is a list of some tickets that can give you a good starting point for hacking on OONI. Some are easier than others to solve. # Easy tickets ooni test decks specifying logfile path but it is not used: https://github.com/TheTorProject/ooni-probe/issues/123 Verify the version of config files: https://github.com/TheTorProject/ooni-probe/issues/190 ooni crashes if no collector option is used with several decks: https://github.com/TheTorProject/ooni-probe/issues/274 # Harder tickets Add support for storing the order in which HTTP headers are received: https://github.com/TheTorProject/ooni-probe/issues/254 Add support for having multiple test classes inside of a nettest file: https://github.com/TheTorProject/ooni-probe/issues/289 Recursion limit problem in TaskManager: https://github.com/TheTorProject/ooni-probe/issues/296 Detect when a probe is using the wrong test helpers: https://github.com/TheTorProject/ooni-probe/issues/158 If you have any questions on these tickets you should either comment on the issue tracker or reply to this email thread. Happy hacking! ~ Art.

1 0

OONI team report for March 2014
by Arturo Filastò 01 Apr '14

01 Apr '14

Here is a summary of the activities carried out by the OONI team in the month of March. ## Released ooniprobe 1.0.1. This is the changelog for the release [1] * Fix bugs in the traceroute test that lead to not all packets being collected. * All values inside of http_requests test are now initialized inside of setUp. * Fix a bug that lead to the input value of the report not being set in some circumstances. ## Bridge reachability Worked on getting a bridge reachability test integrated into master. [2] We now have a test that verifies which tor bridges are working supporting obfs2,obfs3,scramblesuit and ft. This test is now running from 3 different network vantage points in Russia, China and the US. The reports are currently stored inside a private oonib collector until we decide what shall be done with the reports. ## Refactoring of captiveportal test arunpandianp did an awesome job at refactoring the captiveportal test to use our own DNS and HTTP test templates. [3] This has as an effect the fact that we no longer need the dnspython dependency! The other major win is that now the reports for the captiveportal test include (as well as the test specific report data that is backward compatible) also data that is specific to the test templates being used (the DNS queries and answers, the HTTP requests and responses). ## OONI probe package in debian Thanks to Lunars great work we now have a debian package for ooniprobe 1.0.1 [4] ## Planetlab deployment script We now have an automatic deployment script for ooniprobe on mlab. [5] This turned out to be a less trivial than initially expected task given the fact that most planetlab slices run Fedora 8 (yeah the one that is end of life since 2009 :P). This means that a **lot** of things need to be compiled so that we can have a recent version of Tor (for scramblesuit and ft) and a recent version of python (for running ooniprobe). This also lead us to write a couple of tiny patches for pyopenssl [6] and cryptography [7] to support such old distro. ## OONIB admin tool We added a tool for administering oonibackend instances. This allows the administrator to add inputs and decks to the policy without having to manually compute the hashes and edit the policy and collector files [8]. ## Misc bugfixes in oonib and ooniprobe We also fixes a bunch of miscellaneous bugs in ooniprobe [9][10] and oonib [11][12]. ## Least authority audit The audit of oonib and ooniprobe has started in ooniprobe. Their team has been doing a great job also at spotting some bugs [13] and submitting some pull requests with fixes[14][15][16][17][18]. ## Interesting reports collected We can see the escalation of DNS censorship in Turkey in the following reports: https://213.138.109.232/TR/http_requests_test-2014-03-29T000037Z-AS9121-pro… https://213.138.109.232/TR/http_requests_test-2014-03-31T000048Z-AS9121-pro… https://213.138.109.232/TR/http_requests_test-2014-04-01T000033Z-AS9121-pro… https://213.138.109.232/TR/dns_consistency-2014-03-29T000037Z-AS9121-probe.… https://213.138.109.232/TR/dns_consistency-2014-03-30T000023Z-AS9121-probe.… https://213.138.109.232/TR/dns_consistency-2014-03-31T000038Z-AS9121-probe.… https://213.138.109.232/TR/dns_consistency-2014-04-01T000034Z-AS9121-probe.… # What we plan to work on next? * We will be improving the bridge_reachability test and deploy it in more countries. * Work on some charting and graphing for some ooniprobe tests * Evaluate the GSoC submissions. This is all for the moment. Have fun! ~ Art. [1] https://github.com/TheTorProject/ooni-probe/commit/743cf208ebcb1bda3b8eebc8… [2] https://github.com/TheTorProject/ooni-probe/pull/72 [3] https://github.com/TheTorProject/ooni-probe/pull/287 [4] https://packages.debian.org/unstable/main/ooniprobe [5] https://github.com/TheTorProject/ooni-probe/blob/master/scripts/install_on_… [6] https://github.com/pyca/pyopenssl/pull/59 [7] https://github.com/pyca/cryptography/pull/767 [8] https://github.com/TheTorProject/ooni-backend/commit/25fd345bedcabdc6158451… [9] https://github.com/TheTorProject/ooni-probe/commit/8bceb1b2632bb1a3a62d1dfa… [10] https://github.com/TheTorProject/ooni-probe/commit/d982fedd0c28c75d545b9265… [11] https://github.com/TheTorProject/ooni-backend/commit/dc9e53cd63866f894b73ed… [12] https://github.com/TheTorProject/ooni-backend/commit/aebeb92b87bd7b4f19f8b1… [13] https://github.com/TheTorProject/ooni-backend/issues/37 [14] https://github.com/TheTorProject/ooni-backend/pull/36 [15] https://github.com/TheTorProject/ooni-backend/pull/38 [16] https://github.com/TheTorProject/ooni-backend/pull/39 [17] https://github.com/TheTorProject/ooni-backend/pull/40 [18] https://github.com/TheTorProject/ooni-backend/pull/41

1 0