<html><head><style>body{font-family:Helvetica,Arial;font-size:13px}</style></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">Hi Tor people!</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">Below you can learn about what OONI has been up to in June 2017.</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"># OONI Monthly Report: June 2017</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">The OONI team made steady progress in June 2017. </div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">We released the beta version of our measurements API and made significant progress on the re-engineering of our data processing pipeline and on probe orchestration. In collaboration with Access Now, we published a research report on recent censorship findings in Egypt. We also updated test lists in collaboration with our partners, and we continued organizing OONI's Partner Gathering.</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">## Progress on the re-engineering of our data processing pipeline</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">This month we made a lot of progress on the data processing pipeline. The new pipeline is now running on a daily basis side-by-side the existing data processing pipeline.</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">In particular, the measurements API is now using the data generated from the new data processing pipeline to produce the various API endpoints and data is being ingested and processed using our new compressed data format, making it much more space efficient and performant.</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">## Beta release of measurements API</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">We have released a beta version of the measurement API that is using as a backend the re-engineered data pipeline.</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">See: https://measurements-beta.ooni.io</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"> https://github.com/TheTorProject/ooni-measurements/releases/tag/v1.0.0-beta.3</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">This version of the measurements API also adds a couple of new endpoints including:</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">* Support for searching individual measurements (/api/v1/measurements?<query>)</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">* Support for fetching an individual measurement (/api/v1/measurement/<measurement_id>)</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Other improvements include:</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">* Better overall performance</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">* Some bug fixes</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">## Progress on probe orchestration</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">In the area of probe orchestration we made a series of very important improvements, namely:</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">* Added support for creating alert type notifications (this allows us to send messages to users in specific regions, that when clicked on redirect them to some web page)</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">* Switched out the push notification backend with something more stable and reliable (gorush: https://github.com/appleboy/gorush)</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">## Publication of research findings in Egypt</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">We investigated recent censorship events in Egypt and, in collaboration with Access Now, published a research report with our findings. </div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">We were able to confirm the blocking of 10 news websites in Egypt, as well as the blocking of the Tor network, torproject.org, bridges.torproject.org, and even ooni.torproject.org in some networks.</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">The report can be found here: https://ooni.torproject.org/post/egypt-censors/</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">## Updated test lists</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">During June we updated the following test lists:</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Zimbabwe: https://github.com/citizenlab/test-lists/pull/176</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Azerbaijan: https://github.com/citizenlab/test-lists/pull/178</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Palestine: https://github.com/citizenlab/test-lists/pull/180</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Egypt: https://github.com/citizenlab/test-lists/pull/181</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Venezuela: https://github.com/citizenlab/test-lists/pull/184</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">In collaboration with new partners, we also created the following test lists:</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Lesotho: https://github.com/citizenlab/test-lists/pull/177</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Mongolia: https://github.com/citizenlab/test-lists/pull/184</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">## Organizing OONI Partner Gathering</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">We worked on logistics pertaining to the organization of OONI's first Partner Gathering which took place on 10th & 11th July 2017 in Toronto.</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">### Community meeting</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">We hosted our monthly community meeting on https://slack.openobservatory.org/ on 28th June 2017. As part of the meeting, we discussed the following:</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Resources for mapping information controls around the world</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">Creating an information controls database to contextualize network measurements from around the world</div><div id="bloop_sign_1500890195548239104" class="bloop_sign">OONI's upcoming probe orchestration </div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">## Userbase</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">In June 2017 ooniprobe was run 64 times from 1,594 different vantage points across 158 countries around the world.</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">This information can also be found through our stats here: https://measurements.ooni.torproject.org/stats</div><div id="bloop_sign_1500890195548239104" class="bloop_sign"><br></div><div id="bloop_sign_1500890195548239104" class="bloop_sign">~ The OONI team.</div></div></body></html>