- tor-project - lists.torproject.org

Notes from 31 July Network Team Meeting
by Nick Mathewson 31 Jul '17

31 Jul '17

Hi, all! We had another network team meeting today. The log is at http://meetbot.debian.net/tor-dev/2017/tor-dev.2017-07-31-17.00.html Notes from the pad are below. Network team pad, for 31 July Meeting (or 1 August, for those in UTC+5 or later) Notes from last week's meeting: * https://lists.torproject.org/pipermail/tor-project/2017-July/001323.html (Did we do what we had planned?) Announcements and reminders: * Montréal hackfest pad is at Things we should talk about: * Has there been progress on review-group-21 ? * I saw some coverity issues last week but no coverity master. Did they get handled? * We should assign roles for August: https://trac.torproject.org/projects/tor/wiki/org/teams/NetworkTeam/TeamRot… * Isa wonders if we should pursue gitonion because of it not working for folks who are using TB at high security level * What is blocking 0.3.1.x-stable? Tasks for after the meeting: * nickm: fix tor_parse_long regression * everyone: take roles for august * everyone: answer on oniongit email thread! teor (not online): Last week: * Worked with Nick on a spec and draft C code for PrivCount blinding in production tor * Made crypto_rand_double() randomise all the mantissa bits, and remove a slight bias #23061 * Deploy experimental PrivCount for Single Onion Service counts * Start work on a circuit sampling feature for experimental PrivCount, because python can be slow This week: * More PrivCount testing * Maybe re-deploy some additional experimental PrivCount features * Maybe get cell crypto working in endosome Nick: Last week: * Worked with Teor on getting the privcount blinding and tabulation system into Tor. This simplifies privcount a lot because events no longer need to get marshalled and unmarshalled, and makes Tor expose much less information that it does now (or did, under previous privcount branch) * Lots of code review on prop224 stuff. * Misc review and fixes * Merge workaround for some coverity madness; get rewarded with 14 coverity issues; resolve 10 of them. * Delayed 0.3.1.x-stable by a month. This week: * More work on privcount: get spec draft finished with Teor; share with other privcount people and with sponsor Q folks. * Try to finish review on 20657 (prop224 service-side stuff) * Release an 0.3.1.x-alpha * Other hacking TBD dgoulet: Last week: * Service implementation under review in #20657. * Client implementation++ in #17242. I've actually almost exclusively only worked on that. * Prop224 upstream bug opened: #23056 This week: * Finalizing and hopefully putting #17242 in review for upstream. * Assisting asn as needed on nickm's review of #20657. komlo (offline): This week: * Refactoring and getting ready for code review for protover rust * Thinking abuot creating a "intro to rust" coding exercise for the rust hackday ahf Last week: Sponsor 8: - Went over Catalyst + Nick's control port proposal and looked into the control port protocol. - Created a wiki page for network team sponsor 8 planning/notes: https://trac.torproject.org/projects/tor/wiki/org/teams/NetworkTeam/Sponsor8 - Wrapped my head around the Android emulator, but I doubt we will be able to use that for much metrics collections. The android-x86 project might be more relevant here. - Got a test apk to run where I could test Android's "Doze" feature. Misc: - Reviewed #23030, #22883, #22927, #22915, and #20247 - Got a bit excited about asn+dgoulet's prop224 work and got a service running with an ircd to test it out. This week: Sponsor 4: - Fix remaining issues that is missing for Sponsor 4 and 0.3.1. - Write blog post about compression + consensus diff. Sponsor 8: - Look into Android-x86 for a "fast" non-device environment. - Start collecting "Doze" metrics from Orbot to see how we do. - (ahf, please document hwo to do the above stuff as you go along, so that other folks can try it too? -nickm) Misc: - Traveling to SHA2017 at the end of the week. asn: Last week: - Reviewed and tested more #20657 code. - Started fixing up prop224 service-side #20657 based on Nick's review (about halfway there) - Started reviewing and testing David's client-side #17242 branch. - Some hackerone triaging. This week: - Finish up fixing #20657 branch. - Review and test the client-side branch. - Fix more prop224 bugs - Write some unittests for client-side prop224. Mike: Last week: - Finished tor patches for pinning layer2 and layer3 guards (#13837) - Started work on stem-based prop247 prototype/performance simulator This week: - Finish prop247 prototype; Start onionperf testing catalyst: Last 2 weeks (2017-W29, 2017-W30): - moved house - looked into error reporting in test suite in #22636 - started catching up on email and Trac - Tor launcher automation meeting This week (2017-W31): - await arrival of household furniture, etc. - write up some notes to follow up on Tor launcher stuff - file ticket for test suite error reporting issues i noticed in #22636 and write up some of my observations about them - resume attempting to get chutney to do something useful to simulate #20532 isis: last week: - reviewed #22885 - revised my patch for showing info about cert expirations #17639 and wrote a test for it - revised travis configs and got them merged #22636 - fixed a whole lot of brokenness resulting from upgrading the BridgeDB machine to Debian 9 (#22998 #23032 #23033 #23034) - this week: - revising the new captcha server for moat #15967 - working on standardisation and finishing up the crypto needed for hyphae #22775 - updating #16562 with notes from meeting with trevor and reading the generalised edDSA specs/conversations Isabela: Last week: - finished deliverables report for Sue - worked with Erin on onboarding wiki page (thanks for the brainstorming) - submitted modularization proposal and got contract for sponsor8 proposal! - had meeting about tor launcher new design - trying to make sure all teams/people related to it, coordinates between themselves for networkers, TB team will give a wish list for part of the experience that they have to build, so you can review and tell what is possible what is not possible) This week: - july report for sponsor4 - prep work for sponsor8 - prep work for trac/git meeting (which got moved to August7!) - reminder about vacation time (august 7 till 14 - work on 15 - vacation again from august 16 till 21)

1 0

Notes from July 27 2017 Vegas team meeting
by Karsten Loesing 28 Jul '17

28 Jul '17

Notes for July 27 2017 meeting: Georg: 1) Follow-up bug bounty launch work 2) Helped with the support wiki and with thinking about planned Tor Browser toolbar changes 3) Moving forward with the coding tasks for the desktop browser position and helped drafting job descriptions for the mobile ones Nick: 1) I'll be out in August from the 14th through the 18th; 30th through Sep 1. I will see personal email, but will probably be ignoring lists. 2) All seems well on the network team. Slowed down a bit because of vacation series, but 3) I have a suggested clarification for PR about the research board, based on conversation I had with a confused researcher at PETS. Where to send? (Upshot: The only research we oppose is research done by harming users. The only legitimate goal of the board is to avoid harms to users.) 4) PETS note: The research community is speeding up about producing useful stuff again. - Should we do anything to resurrect anonbib? - Let's go back over the week and write up everything we need to do or think about wrt Tor based on PETS talks and conversations, before we forget.. 5) Sponsor Q: I've been coordinating with Teor to make sure that Privcount advances, in fulfillment of our SponsorQ privacy-preserving measurement goals. There's a tor patch for the backend now. 6) Sponsor R: There is no way that the prop224 hs-ng branch gets merged before Roger's talk tomorrow. But an August merge still does look likely. 7) Just deferred our release date for 0.3.1.stable by a month, to early September. Isabela: 0) Was at PETS last week - we submitted DRL Core Tor Modularization SOI \o/ 1) Working with Erin and folks on the onboarding wiki page - https://share.riseup.net/#zTanTv1bj7dtkCiwiE5DKg 2) UX/Linda - worked with Linda on website redesign building the information architecture for torproject.org page while we were at PETS (got feedback from Roger, Mike and other folks at PETS on it too) Next step is to create new wireframes based on that and present to comms team on August 15. Working with Linda on different UX problems (TB toolbar, .onion and ssl certificates behavior, tor launcher) we are trying to use the model of problem definition, hypothesis brainstorming, pick a hypothesis to build and the test it, iterate if needed in order to fix UX issues. We should stick to this model as much as possible. Also working on building a user test for Onion Browser onboarding project. 3) services land/Hiro - hiro is on vacation these days - this and the other time when we needed a tb release and geko was out on vacation, lead me to suggest the creation of 'vacation backup table' (email sent to tor-internal) / plan to follow up on that next week. 4) Other work going: deliverables reports, sponsorR stuff for Roger, Sponsor8 prep work, following up with proposals, prep for Orfox release next week, meetings meetings meetings Steph: 1) Working with Erin, Isa, Tommy on onboarding wiki 2) Been working on blog content, lots of posts lined up 3) Still waiting on Giant Rabbit to finish newsletter setup, then will have to edit content depending on when they're ready 4) Keeping up with ongoing comms stuff: regular social media posting scheds, responding to press, building press list Karsten: 1) Cleaned up metrics hosts after upgrading to Debian stretch. 2) Decided to accept data from researchers on "contributed" pages and linked data on the Tor Metrics website. Starting with two research groups, currently discussing details. Should probably announce this once the pages are online. 3) Assisted in writing the MOSS final report, which will likely go on the blog once it's out. Shari: 1) Finishing up final report for MDF on donation funding. 2) Lots of meetings re: various funding stuff. 3) I'll be traveling quite a bit this next week. Mike: 1) PETS meeting with traffic analysis researchers went well. Discussed blockers and steps forward 2) Got Sponsor2 year 1 report materials to Matt Wright

1 0

Dutch police and Tor in the AlphaBay/Hansa operation
by Cristian Consonni 26 Jul '17

26 Jul '17

Hi, some context: «Dark web marketplaces AlphaBay and Hansa shut down»[1] The police has put up a couple of pages with a list of usernames that they identify as customers or vendors of the markets and some FAQs[2a][2b]. Note (from [2b]): --- Have you de-anonymized TOR? No. But if we would have, we wouldn't tell you ;). --- and also (from [2a]): --- Are you against TOR? No, the Dutch police and judicial authorities are not against the anonymous use of the internet, encryption or TOR. We only act when these techniques are being used for committing criminal offences. --- Cristian [1]: https://www.theguardian.com/technology/2017/jul/20/dark-web-marketplaces-al… [2a]: http://politiepcvh42eav.onion/faq.html [2b]: http://politiepcvh42eav.onion/hansafaq.html

2 1

Onboarding wiki - we want your input! :)
by Erin Wyatt 25 Jul '17

25 Jul '17

Hello everyone! Hello! Isa and I will be getting together next week to work on the onboarding wiki page, and we'd like your input! If you have a moment, please tell us your idea(s) on how to improve the way we orient newcomers (all types). We’ll start on Wednesday, so anytime before then would be grrrreat. We're looking for all kinds of suggestions -- From IRC/email/encryption etiquette to process/procedure for starting new projects and getting support to technical/security/privacy suggestions and/or requirements -- WE WANT IT ALL. >:) There are three categories: 1. Things I wish I had known when I started with Tor Project (in any capacity). 2. Things I wish new people knew when they started with Tor Project. 3. Things that don't fit into either of the above categories, but should still be recorded on the Onboarding Wiki. Please submit your ideas here: https://pad.riseup.net/p/Tor_Project_Onboarding_Brain_Dump If you prefer to email your suggestions, that’s fine! Also, if you have a document or a link to a personal pad with the info, please email it to me. Thanks in advance! Hope you’re all having a great week. Cheers, Erin Wyatt HR Manager ewyatt(a)torproject.org GPG Fingerprint: 35E7 2A9F 6655 45F9 2CB6 6624 BA0C 9400 F80F 91CE

2 1

Network team meeting notes, 24 July 2017
by Nick Mathewson 24 Jul '17

24 Jul '17

Hi! Below's the pad from this week's meeting. The meeting transcript is available at http://meetbot.debian.net/tor-dev/2017/tor-dev.2017-07-24-17.00.html ===== Network team pad, for 24 July Meeting (or 25 July, for those in UTC+5 or later) Notes from last week's meeting: * https://lists.torproject.org/pipermail/tor-project/2017-July/001305.html (Did we do what we had planned?) Announcements and reminders: * Various network team hckfests are on 9th to 16th October. Nickm is confused about when. - we should make a pad for the schedule isis wrote, with updates (komlo) * I've added the August calendar for the Team Rotation -dgoulet * Not much progress on review-group-21 :/ Things we should talk about: * Tasks for after the meeting: * teor (not online): Last week: * Took a few days leave, because ugh, winter, again * Wrote some more tor circuit code for endosome, found some tor-spec ambiguities * Did a code review on some of Rob's PrivCount code * Booked Montreal travel and arranged hackfests and meetings * Worked out when the grant money for my current job will run out This week: * Implement one final PrivCount feature before deployment * Test PrivCount before deployment * Deploy and Run PrivCount Single Onion Service counts * Maybe get cell crypto working in endosome taylor: (I believe this is the week that Taylor is moving. Let's all wish them an easy relocation! -nickm) asn Last week: - Wrote patch for #22735. Found and fixed some bad bugs on #20657 while writing this patch. - Wrote code and tests for #22940. - Continued review and testing of #20657. Found some more issues, particularly regarding the overlap mode and descriptor rotation logic. - Reviewed #22895 and #22979. - Did some hackerone bug triaging since we publicly launched our bug bounty campaign. This week: - Mod HS circuitmap to be used by client side prop224 for RP circs. - Continue reviewing and testing of service-side #20657. Find and fix more bugs, and hopefully move it towards upstream merge. - Start reviewing David's client-side code. - We are approaching prop224 merge time, so do any other prop224 action items that must happen. nickm: Last week: - PETS. Had good convesations about . A couple of interesting attack papers . anti-fingerprinting research . traffic padding . The research safety board . I2P . getting large patches/add-ons deployed This week: . Review, merge, bugfix. :( . Document, specify :( . Work on guard stuff, measurement, trace stuff. (dgoulet: lttng advice? Also I should coordinate with teor) . Enter sadly delayed sponsor8 items from meeting with ahf onto bugtracker so I can't forget ahf (might be missing the start of the meeting): Last week: Sponsor 8: - Up and running with Android development environment for Orbot + Core Tor. - Up and running with Android power measurement via their dodgy Python scripts (on a nexus 5x). - Met with a friend in Copenhagen to get a fast walkthrough of the Android environment. Misc: - Did a talk on Tor at TheCamp.dk. This week: - Document Sponsor 8 development environment with Android on trac wiki. - Figure out how we can collect measurement on Android about battery/CPU usage where we have "fast" test-to-result times. - Create tickets for sponsor8. - Look into our wake-ups on an Android device. - Figure out how much we can measure CPU wake-ups/network via the Android simulator. Things I could need help with: - Find Nick + Catalyst's pad/log about control port enhancements (URL?) - Need to figure out what functions in core tor that does network activity on timers. dgoulet: Last week: - Massive amount of prop224. Addressing asn's review of #20657 - Mostly coding #17242. - Prop224 is now closer to reality where we had our first client<->service connection yesterday ;). The whole chain has been glued together and is working! This week: - Finalize #17242 (client code) so we can test the whole stack more thoroughly. - Need to make a branch that contains it all for arma so he can showcase it at our *last* final sponsor R meeting and then two days later to Defcon. - Basically, expect me to only focus on prop224 so we can reach our deadline goal and start merging more and more upstream. komlo (not online): - I am starting my new job this week (!!), so will pick up more tor work next week pastly (also attending meeting in #tor-project for people who provide support): - Measuring latency in Tor seems to be going well. Reimplemented Ting all last week. - Now that Rob is back from PETS, will discuss how to update KIST tickets. Mike: Last week: - PETS - Met with Matt Wright, Marc Juarez, Moshen Imani, Nick, Roger about prop254 - Discussed potential issues with flow control and other planned histogram changes - Worked with Matt on outline of stuff for Sponsor2 report. (He will be submitting it.) This week: - Catch up on mail and other things since PETS - Flesh out details for Sponsor2 report; send them to Matt - Work on torrc options for Prop247 prototype (#13837) - Help with Tor Browser interview process Isabela: Last week: - PETS - Finished the modularization proposal - submitting as we meet (today, cuz we were waiting to hear back from Laura on a question related to the submission form) This week: - NSF reports! help organize that for arma (Mike already created a plan for sponsor2 one while at PETS) - We got sponsor8 contract!! I will get you more info as we figure out if we want our start date to be August 1st or later - July is ending and I wonder if we are closing the deliverable for sponsor 4 - I sent an email to try to create a backup person plan for vacation season - sent to tor-internal. isis: last week: - sending out emails for internship and getting things set up for them - discussions about differences in signatures #16562 - upgraded bridgedb server to Debian 9 and recalibrated the CI #22998 - did some thinking about potential security implications of not having random payloads in drop cells #22948 - revised tor.git travis CI configs #22636 - looked into dependency libraries for intern project this week: - revise captcha server for moat according to review/specs #15967 - get the bridge bandwidth scanner project rolling

1 0

Linda away 8/1-8/4 (Tues to Friday next week)!
by Linda Naeun Lee 24 Jul '17

24 Jul '17

Hi all, I'll be in Canada for a destination wedding + vacation. Isabela will be the one facilitating the UX ticket triage meeting on 8/1 and UX team meeting on 8/2, so those will still be on. Cheers, Linda N. Lee Current Key: https://pgp.mit.edu/pks/lookup?search=lindanaeunlee GPG Fingerprint: FA0A C9BE 2881 B347 9F4F C0D7 BE70 F826 5ED2 8FA2

1 0

OONI Monthly Report: June 2017
by Arturo Filastò 24 Jul '17

24 Jul '17

Hi Tor people! Below you can learn about what OONI has been up to in June 2017. # OONI Monthly Report: June 2017 The OONI team made steady progress in June 2017. We released the beta version of our measurements API and made significant progress on the re-engineering of our data processing pipeline and on probe orchestration. In collaboration with Access Now, we published a research report on recent censorship findings in Egypt. We also updated test lists in collaboration with our partners, and we continued organizing OONI's Partner Gathering. ## Progress on the re-engineering of our data processing pipeline This month we made a lot of progress on the data processing pipeline. The new pipeline is now running on a daily basis side-by-side the existing data processing pipeline. In particular, the measurements API is now using the data generated from the new data processing pipeline to produce the various API endpoints and data is being ingested and processed using our new compressed data format, making it much more space efficient and performant. ## Beta release of measurements API We have released a beta version of the measurement API that is using as a backend the re-engineered data pipeline. See: https://measurements-beta.ooni.io https://github.com/TheTorProject/ooni-measurements/releases/tag/v1.0.0-beta… This version of the measurements API also adds a couple of new endpoints including: * Support for searching individual measurements (/api/v1/measurements?<query>) * Support for fetching an individual measurement (/api/v1/measurement/<measurement_id>) Other improvements include: * Better overall performance * Some bug fixes ## Progress on probe orchestration In the area of probe orchestration we made a series of very important improvements, namely: * Added support for creating alert type notifications (this allows us to send messages to users in specific regions, that when clicked on redirect them to some web page) * Switched out the push notification backend with something more stable and reliable (gorush: https://github.com/appleboy/gorush) ## Publication of research findings in Egypt We investigated recent censorship events in Egypt and, in collaboration with Access Now, published a research report with our findings. We were able to confirm the blocking of 10 news websites in Egypt, as well as the blocking of the Tor network, torproject.org, bridges.torproject.org, and even ooni.torproject.org in some networks. The report can be found here: https://ooni.torproject.org/post/egypt-censors/ ## Updated test lists During June we updated the following test lists: Zimbabwe: https://github.com/citizenlab/test-lists/pull/176 Azerbaijan: https://github.com/citizenlab/test-lists/pull/178 Palestine: https://github.com/citizenlab/test-lists/pull/180 Egypt: https://github.com/citizenlab/test-lists/pull/181 Venezuela: https://github.com/citizenlab/test-lists/pull/184 In collaboration with new partners, we also created the following test lists: Lesotho: https://github.com/citizenlab/test-lists/pull/177 Mongolia: https://github.com/citizenlab/test-lists/pull/184 ## Organizing OONI Partner Gathering We worked on logistics pertaining to the organization of OONI's first Partner Gathering which took place on 10th & 11th July 2017 in Toronto. ### Community meeting We hosted our monthly community meeting on https://slack.openobservatory.org/ on 28th June 2017. As part of the meeting, we discussed the following: Resources for mapping information controls around the world Creating an information controls database to contextualize network measurements from around the world OONI's upcoming probe orchestration ## Userbase In June 2017 ooniprobe was run 64 times from 1,594 different vantage points across 158 countries around the world. This information can also be found through our stats here: https://measurements.ooni.torproject.org/stats ~ The OONI team.

1 1

GSoC 2017 Ahmia status update #4
by Pushkar Pathak 22 Jul '17

22 Jul '17

Hello everyone, This is the bi-weekly status report for Ahmia - Hidden Service Search ## Fixed broken statistics page Statistics page has been fixed and is working at 'ahmia.fi/stats/'. [0] ## Linking structure of onions Linking structure of onions is visualized at '/stats/link_graph/'. [1] The data for popularity of domains according to clicks and backlinks is not currently available. This graph will be updated once this data is available. Next task is to update documentation and software dependencies. Thanks, Pushkar Pathak [0] : https://github.com/ahmia/ahmia-site/commit/142a661ed638cb4ef28a4bcba3814c5f… [1] : https://ahmia.fi/stats/link_graph

1 0

GSoC 2017 - unMessage: Report #4
by Felipe Dau 21 Jul '17

21 Jul '17

Hi everyone! This is my report #4 for the unMessage GSoC project. # Updates Since the last report I continued working on #21 [0] to properly use Twisted: - Finished making the Peer class' methods asynchronous - Installed the reactor in both UIs - Removed support for the Peer class running/calling its own reactor from a thread as now both UIs pass one to the constructor I also started changing some other parts that should not depend on IO to just make objects talk to other objects to simplify writing unit tests for #33 [1]. # What's next As #21 and #33 are complex tasks, I will continue working on them in the next period of GSoC. This period was more focused on using Twisted correctly (#21) and the next one will be more focused on testing (#33). More details on these tasks can be followed in the respective tickets [0, 1] and branches [2, 3]. Thanks, -Felipe [0]: https://github.com/AnemoneLabs/unmessage/issues/21 [1]: https://github.com/AnemoneLabs/unmessage/issues/33 [2]: https://github.com/felipedau/unmessage/tree/21/deferreds [3]: https://github.com/felipedau/unmessage/tree/33/feature/test-suite

1 0

GSoC 2017 - Crash Reporter for Tor Browser: Report #4
by Nur-Magomed 21 Jul '17

21 Jul '17

Hi everyone! This is my bi-week status report for GSoC project "Crash Reporter for Tor Browser". # The work was focused on Crash Reporter server side: - we took Mini-Breakpad-Server (MBS) [1] instead of Socorro: there were problems with setting up Socorro and we decided to make work version with MBS; - splitted it into 2 services [2]: MBS-Submit (to get reports that's sent by Crash Reporter client) and MBS-View (to view gotten reports). # What's next We plan consider carefully Crash Reporter data fields (that sends) and making reproducebly build TorBrowser with enabled Crash Reporter. Kind regards, Nur-Magomed [1] https://github.com/electron/mini-breakpad-server [2] https://github.com/nmago/mini-breakpad-server/commit/da3e4ed015a288ef7261bb…

1 0