June 2016 - ooni-dev - lists.torproject.org

Fwd: [metrics-team] Fwd: [tor-team] Finding a date for the Berlin meetup
by Vasilis 30 Jun '16

30 Jun '16

Hello, Perhaps this would be of interested to OONI people wishing to meet-up in Berlin. Cross posting from metrics-team: -------- Forwarded Message -------- Subject: [metrics-team] Fwd: [tor-team] Finding a date for the Berlin meetup Date: Tue, 28 Jun 2016 20:54:34 +0200 From: Karsten Loesing <karsten(a)torproject.org> To: metrics-team(a)lists.torproject.org <metrics-team(a)lists.torproject.org> Hi metrics team, we were thinking about having a metrics team meeting in Berlin in August or September. Georg had a similar idea of organizing a meeting of Tor people, some of which wouldn't be able to make it to the Seattle dev meeting later in September. That's why we thought about merging the two meetings to reduce the overall planning overhead and to get more Tor people together. Please fill out the Doodle that Georg mentions below if you'd like to attend the full meeting or just the metrics-related part of it. And no worries, we won't force you to attend the full meeting if you can only attend one or two days. All the best, Karsten -------- Forwarded Message -------- Subject: [tor-team] Finding a date for the Berlin meetup Date: Tue, 28 Jun 2016 17:10:44 +0000 From: Georg Koppen <gk(a)torproject.org> Reply-To: tor-team(a)lists.torproject.org To: tor-team(a)lists.torproject.org <tor-team(a)lists.torproject.org> Hi everyone, a while back we started discussing a possible meetup before the Seattle meeting (see tor-internal thread). It seems there is at least some interest in it which is why I prepared a Doodle poll to nail down the final weekend: http://doodle.com/poll/tziw2ikwvgw2w8tf To recap: what we intend so far is meeting at the end of a week + the weekend (Fri-Sun) in Berlin at the end of August/begin of September in the Onion Space. There is no agenda yet (and maybe we won't even have a formal one) but I guess all of us can think of topics for it. If you feel this is something for you don't hesitate and fill out the poll so we can get things started especially for those of us that need to hunt down plane tickets and need to take care of associated logistics. FWIW it is perfectly fine if you think about not being around the whole three days. The poll is only for picking one of the Friday-Sunday periods. I plan to send a reminder on Friday and hope to announce a "winner" early next week. Thanks, Georg ~Vasilis -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162

1 0

Reminder for weekly OONI dev gathering Monday 2016-06-27 17:00 UTC (19:00 CEST)
by Arturo Filastò 27 Jun '16

27 Jun '16

Hello Oonitarians, This is a reminder that today there will be the weekly OONI gathering. It will happen as usual on the #ooni channel on irc.oftc.net at 17:00 UTC (19:00 CEST, 13:00 EST, 10:00 PST). You can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni. Here is a proposed agenda for this weeks meeting: * Discuss how to approach making ooniprobe into a system daemon and considerations around making this effort something that could be shared/helpful to, measurement-kit and neubot as well. * Discuss approached to making the GUI for ooniprobe and in particular what can be done to maximise code-reuse and sharing of GUI aspects between ooniprobe on desktop, netprobe on mobile and possibly also ooni explorer. Feel free to add more items either by replying to this thread or adding them to https://pad.riseup.net/p/ooni-irc-pad Everybody is welcome to join us and bring their questions and feedback. See you later, ~ Arturo

1 0

(tor)ssl_observatory ooni-probe tests
by Vasilis 25 Jun '16

25 Jun '16

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hello everyone, It came to my attention that there are a couple of reports that have been made with the following tests (names): - - ssl_observatory - - tor_ssl_observatory It will be nice to have these tests available in ooni-probe tests base, otherwise these reports don't make that much sense. Thanks! ~Vasilis - -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162 -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJXbhbNAAoJEF+/cLHRJgFi9qsP/RlT/5bccQix28J+BUoN6zUK +KAorgoU8ofktc21VBxS6mCNa8nRuVH6wUo4PZ0uGMW5IUUI9VX6caXaSrLK2VzD mg7PB+CVkNd8k8fs9uaGgnoHq6LPNrONNL+dHyiiBt9abLeCNbiSfD+Ygg4hEkjb FfjGF8/M/Lfw4gIxtEkL3NHLK4UnpdpfMUcehqZXo5bI/DNlX2rus7mfnaytqlnh fuMUrD5hb8EzbJfI8DM1MIxoiiox3AYohKzIElVgf0BmRhCWGmBpMED3YxrX4KtN eZBa/TLfX/5y8jb5comzL/oKn1FLYmb5wjm7IGubpwOCDAWWDVg+UB6xFItb57fV UR2pM0d5fnmi/8WPRg922YJQKKh+y8ESLMHcvOaQs501ClRiz7y9a/Z2jIUUWKcM HIhxG6c5zFIqSv8eJNmn+GSVUS+VQ/tgxlMfP+A/CIAzyDPHv5nyOYCwOYXNjPav e3hv8reVjqvUlgpsbXZqsvX+bYnpgHvzl4ZOIZ2UlGBxfwaA3S3CpW3j3Jj6T5ND Kjz5VlQ72lLDGSWgPyQuKriYKP5UuT9zUKgv92/CJOdD6/nl7ub507j1NzKXHia5 z+0BUcs+Wp985+KZesYr5s8j2CMyTgsS3txugcZMXY7J5Nxks+SW6Or7fx1CKcVN 7PqRYBaFlwZMYiuqgN+p =fIsD -----END PGP SIGNATURE-----

1 0

Reminder for weekly OONI dev gathering Monday 2016-06-20 17:00 UTC (19:00 CEST)
by Arturo Filastò 20 Jun '16

20 Jun '16

Hello Oonitarians, This is a reminder that today there will be the weekly OONI gathering. It will happen as usual on the #ooni channel on irc.oftc.net at 17:00 UTC (19:00 CEST, 13:00 EST, 10:00 PST). You can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni. Here is a proposed agenda for the meeting: * Discuss the behaviour of ooniprobe when adding cloudfronted and https collectors (i.e. there is now a preferred_backend option that defaults to onion, but we could make it default to something else) * Agree on a release date for the new version of ooniprobe and triage tickets of things to be included in it. Feel free to suggest other topics by either replying to this thread on noting them on the pad at: https://pad.riseup.net/p/ooni-irc-pad Everybody is welcome to join us and bring their questions and feedback. See you later, ~ Arturo

1 0

Reminder for weekly OONI IRC meeting: *Friday* 2016-06-17, 17:00 UTC in #ooni
by Vasilis 17 Jun '16

17 Jun '16

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni channel on irc.oftc.net at 17:00 UT C. Event Times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20160617T17 You can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni Everybody is welcome to join us and bring their questions and feedback. Please use the meeting agenda pad if you have any topics: https://pad.riseup.net/p/ooni-irc-pad ~Vasilis - -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162 _______________________________________________ ooni-dev mailing list ooni-dev(a)lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/ooni-dev -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJXZBL+AAoJEF+/cLHRJgFiXs0P/2eoW4FXF4wQDW1HiaJMMjFu Rp9/xOfg15kElExLN8pKuUf7kvjI45oDiZaosVpWeGAW442G5pnPdw+fx4dGxezd hnNeN6RSrUeaoogpL/xU0LLun3S1bvMuk88lIpkR5XfncvftJZqggY5McIMrGehv NdSKQk4yXQwzIxEFxPbk+wd+hSVKukNGQelQgk/DECBmkDKvDkZPyJhH6ZY7Fp4a EtDtkbRnBYfB1q+8WtaZdaPn76f6+aCrjrftbEK7dlzLn/aP691l8llwjDUHfjsK aAsRCSpNXwUS9420LdN33zgfuMYeMF1MAZ1grQ3w7zWmj7VwDOmQpNV7btzXfVl6 nQCIYl/sxRiaOc7kkfo2vp/CUVE+Gjtr0J0k7+caVn9RX8BgCwHKa8vydyW+siDn jaPrCV8694QHMasSgnKlkci1BGHqp5iZBPWpqByGe0c7u9L/hOVsypnaKPIT9wQ6 arU25Tw6cIxfX/Na3VzEqgL+B5HjNsbUBrPzyE9hhX44P514s1RQ7jOp3hEqv2n0 2R0d5T9uUJ0vSSxdhIAH96vydqlNtPUODYL9GL8MJWdRNh73U+2ltCW1rh763R+G 9lokg9NjL8cQ0AaJMInfHd9luZ9UI0HSbJfOJrUOuStj7aPfwmXu0FKz19UiK8M8 tbTAq998p6eJoomHKgD3 =5jig -----END PGP SIGNATURE-----

1 0

Re-scheduling the OONI weekly dev gathering
by Arturo Filastò 14 Jun '16

14 Jun '16

Hello Oonitarians, Unfortunately I will not manage to attend the OONI weekly gathering today, so I would suggest re-schedule it to sometime this week or skip it to next week. If we are to do it this week we should have an agenda and I would suggest as a time and date Wednesday 17:00 UTC. ~ Arturo

1 0

Reminder for weekly OONI IRC meeting: Monday 2016-06-06, 17:00 UTC in #ooni
by Vasilis 07 Jun '16

07 Jun '16

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hello everyone, This is a reminder for today's weekly OONI IRC meeting. It will happen as usual on the #ooni channel on irc.oftc.net at 17:00 UT C. Event Times around the world: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20160606T17 You can join via the web from: https://kiwiirc.com/client/irc.oftc.net/ooni Everybody is welcome to join us and bring their questions and feedback. ~Vasilis - -- Fingerprint: 8FD5 CF5F 39FC 03EB B382 7470 5FBF 70B1 D126 0162 Pubkey: https://pgp.mit.edu/pks/lookup?op=get&search=0x5FBF70B1D1260162 -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJXVWqgAAoJEF+/cLHRJgFiJuUP/i1Oi12LIITn8BBTbgRUDVEy W3/ekTCJsp6WR+6fap5NCWg7XHAuzrcA/AQ7Oal+nI6U1FBKfwGd9YTZjHkwYrxy sAcPuZfTvNNJsUzUERmRxorQEa50QZjJplby4lz53kqfjGR5NVCn0Vh7vD8/NaJQ +v9+zEInKrEJO3Nfm9Os7oGZYTzhy6aH7T8QZUyVZN4Xy3hvBrzDK65VGjxtDJnj Y/HMWEcRnf4xKmV3IhuldfIvnna4qo0QyYvRy5snvOmBYmOVyRWTumEB+gHY5Ypi mekc7EjS3S6Eyo5b9y+ZEfFIvLstfE583JBwFyGkf6e8KKO+5V66DdPWZPeAowk1 VQrZiTcqBDAk62CktwRa6S4KAyvPYKK0iSSGLWTbrg55kyOLXrPgzYyzCb8n005f YS6YlL28iIe6DmSHjIet+98EZqhwmywD+G+AYBXzyRopMWP1idYFpQ3CE7+UgHpU SaiY6fA01MjkB56DIqEpylIL4R7cDCuTAcJ4glbQnJ2/5UER2/wq1HGw0wpcSuhM Q/2RjYk24QI3a6/LhKyFLav5GkPNdNea7pQBph/tWAltXfdfTD1i0BHh0VxZ4Csc cUa0iKto8aa0R99zRY09UjSzklBH0P9rualb8An/VDhDuV6DdHlu4R1RIwVEDv1M gWUhSSKcbQRgzYHM3w2i =ZK2i -----END PGP SIGNATURE-----

2 2

Reports from UK are currently not being processed
by Arturo Filastò 06 Jun '16

06 Jun '16

Dear Oonitarians, Due to the large volume of reports coming in from the UK, we have as a temporary workaround stopped processing them through our pipeline since 2016-04-28. This is due to the fact that some OONI user in the UK instead of using the standard way of supplying a list of URLs to test (by means of an input file with the -f command line option). Instead they appear to have scripted ooniprobe to run one instance of ooniprobe per URL with (for x in URLS;do ooniprobe blocking/http_requests —url $x;done). In doing so we are receiving about 4k reports a day from the UK. If you are running ooniprobe in this way, could you please adjust your configuration to instead of running one instance of it per URL, use the -f option? This does not mean that the reports from the UK are not being collected, but it does mean that they will not show up on either the explorer or the measurements page until we implement a proper fix for handling such large number of reports. We apologise for the inconvenience and will be working towards having a better fix for this issue in the future. ~ Arturo

1 0

Bug#826467: ITP: oonibackend -- backend infrastructure for ooniprobe
by Iain R. Learmonth 06 Jun '16

06 Jun '16

Package: wnpp Severity: wishlist Owner: "Iain R. Learmonth" <irl(a)debian.org> * Package name : oonibackend Version : 1.3.0 Upstream Author : OONI Developers <ooni-dev(a)lists.torproject.org> * URL : https://github.com/TheTorProject/ooni-backend * License : BSD-2-clause Programming Lang: Python Description : Backend infrastructure for ooniprobe oonibackend is used by ooniprobe to discover the addresses of test helpers (via the bouncer) to submit reports to (via the collector) and to perform some measurements that require a backend system to talk to (via test helpers). ------------------------------------------------------------------------ This packaging work will be done within the Internet Measurement Packaging Team <pkg-netmeasure-discuss(a)lists.alioth.debian.org>. --

1 0

New release: ooniprobe 1.5 is out!
by Arturo Filastò 03 Jun '16

03 Jun '16

Hello Oonitarians, We are pleased to announce a shiny new release of ooniprobe! The major feature present in this version of ooniprobe is a new test called Web Connectivity the tests for TCP/IP based blocking, DNS consistency and HTTP blocking all in one. You can read more about this new test in our blog post about it here: https://ooni.torproject.org/post/web-connectivity/ If you have installed ooniprobe with pip, you can upgrade to the latest version by simply running: pip intall ooniprobe --upgrade The new debian package will also follow. Here is the changelog summarising the changes: v1.5.1 (Fri, 03 Jun 2016) ------------------------- codename: The Big Wave New features: * Add --default-collector option to oonireport * Implement web_connectivity test that measures for both DNS and HTTP censorship. Bugfixes: * Fix a regression bug that lead to Tor exit ip address not being included in reports. Happy testing! ~ Arturo

1 0