- tor-project - lists.torproject.org

June 2017 report for the metrics team
by Karsten Loesing 04 Jul '17

04 Jul '17

Hello Tor, hello world! Below you'll find the highlights of Tor metrics team work done in June 2017. On behalf of the Tor metrics team, Karsten Published a blog post to announce the release of Tor Metrics Library 2 [1]. [1] https://blog.torproject.org/blog/tor-descriptors-la-carte-tor-metrics-libra… Released Tor Metrics Library versions 1.8.0 [2], 1.8.1 [3], 1.8.2 [4], 1.9.0 [5], and finally 2.0.0 [6] with numerous changes as described in the change log [7]. [2] https://lists.torproject.org/pipermail/tor-dev/2017-June/012299.html [3] https://lists.torproject.org/pipermail/tor-dev/2017-June/012305.html [4] https://lists.torproject.org/pipermail/tor-dev/2017-June/012322.html [5] https://lists.torproject.org/pipermail/tor-dev/2017-June/012342.html [6] https://lists.torproject.org/pipermail/tor-dev/2017-June/012362.html [7] https://gitweb.torproject.org/metrics-lib.git/plain/CHANGELOG.md Completed all remaining Sponsor X deliverables running from July 2016 to June 2017 [8]. [8] https://trac.torproject.org/projects/tor/wiki/org/sponsors/SponsorX

1 0

June 2017 Transifex report
by Colin Childs 04 Jul '17

04 Jul '17

Hi everyone, Below is the monthly Transifex report for June, 2017: ### Report Attached are daily, weekly and monthly translation graphs. The Y axis is "source words". 13.60K source words 3,319 collaborators 154 languages 42 Project resources 6 languages at 100% completion (across all 42 project resources): Chinese (Taiwan) (zh_TW) French (fr) French (Canada) (fr_CA) Norwegian Bokmål (nb) Spanish (es) Turkish (tr) -- Colin Childs Tor Project https://www.torproject.org Twitter: @Phoul

1 0

Network team meeting notes, 3 July 2017
by Nick Mathewson 04 Jul '17

04 Jul '17

Hi; we had our regular meeting. Logs here: http://meetbot.debian.net/tor-dev/2017/tor-dev.2017-07-03-17.00.html And updates below: =================== Network team pad, for 3 July Meeting (or 4 July, for those in UTC+5 or later) Notes from last week's meeting: * https://lists.torproject.org/pipermail/tor-project/2017-June/001217.html (Did we do what we had planned?) Announcements and reminders: * review-group-19 ? * There are still ? tickets in 0.3.1.x, including ? in status "new" with no owner. We need to get 0.3.1.x done! * Timesheets and expenses today, please!!! * Remember to take slots in the rotation: https://trac.torproject.org/projects/tor/wiki/org/teams/NetworkTeam/TeamRot… * Reminder - isabela will be off the rest of week Things we should talk about: * I want a Windows tor developer for Christmas, but I think we'll get mobile first -teor * TROVE-2017-007 is openbsd only; need backport advice. Could use a backport team in general. -nickm * We should talk about regression tests, timing, etc -nickm Tasks for after the meeting: * teor (not online): Last week: * Started collecting entry and exit stats with PrivCount 1.0.2 * Wrote draft PrivCount Tor code to count middle circuits and cells * Helped out with tor security fixes * Tried to help out with relays stuck with low measurements #22741 #22798 #22744 https://trac.torproject.org/projects/tor/wiki/doc/MyRelayIsSlow * Reviewed some of the circuit padding code This week: * Implement and test rendezvous circuit counts in PrivCount (We'll find out the rough usage of Tor2web and Single Onion Services) asn [Will not be home today during the meeting times.] Last week: - Did lots of reviewing on #21979. Still not done but getting there. Comment posted. - Fixed #22006 based on nick/isis review and now it's merged upstream. - Addressed coverity issue #22746. - Reviewed #15554, #22726, #22727. - Continued prop247 simulation. Started making first graphs. Adversary models are still pretty rough. - Opened #22735 and #22736 about prop224 and desc overlap period. - Wrote Wilmington blog post. Still unpublished. This week: - Finish #21979 review. Start next service-side review. - Continue prop247 simulation. - Publish wilmington blog post. nickm: Last week: * Security updates for TROVE-2017-006; new releases for 0.3.0 and 0.3.1. * Review, triage, merge, misc bugs. * Fuzzed tor_inet_pton, to no avail, since I was on linux. * Hardware issues ate a bit of my time. * Learned about harvest some. This week: * More 0.3.1 bugfix work. :p * Isabela sent me the time allocation spreadsheet betwen now and end-of-yearish. I should get it out to everyone today! * Prioritizing code review, then sponsor8 preliminaries and other code triage for 0.3.2 * It would be nice to program something. * Review time-allocation thing with everyone * Figure out whether I'm supposed to be reviewing timesheets? ahf: Last week: Sponsor 4: - Landed fix for #22702 and #22751. - Reviewed: #22752, #22719, #22797 - Started a measurement for Sponsor 4 with a Tor compiled without LZMA and Zstandard support. - Started to land updates to dir-spec.txt for prop #278 in GL/ahf/torspec/tree/prop278-in-dir-spec (#22275) Misc: - Wrapped my head around our release process. Tried to help Nick out with the release for 0.3.0.x and 0.3.1.x. - Testing of releases on OS X, FreeBSD, and Linux. - Switched from text file notes for the week to Harvest. Seems good so far. - Did everything needed before the end of the fiscial year (I hope! Items are "pending approval"). This week: - Help out with 0.3.1 issues: - Go over the Sponsor 4 measurement issues and figure out: which is solved by the current knowledge and data we have, which can be solved easily with some modifications, and figure out if there is any of them that requires any modifications to Tor that we don't currently have. - Look into the mobile proposal email from Isa. haxxpop: last week: - tried to understand fuzzing framework, but i still don't understand it much this week: - I will try to continue doing fuzzing catalyst: Last week: * bug triage * Updated TorOnTrac keywords from pad * #22745 Started regression testing discussion * #22762 reviewed komlo's edits (coding standards make check expectations) * #22773 stem fix for random nicknames on 64-bit platforms * [sponsorM] Tor Launcher UX meeting * Reproduced #20532 pluggable transport bypass; can anyone else replicate? * Opened #22743 for ed25519 point validation documentation This week: * Nail down which days I'm taking off this month for moving and notify people * Still some stem issues with lack of system tor * Look more at 0.3.1 tickets pastly: last week: PrivCount this week: rebase + squash KIST in a reasonable way dgoulet: Last week: - Put #21979 in needs_review. Big step towards prop224 service merge. - Couple of prop224 groundwork tickets have been filed which are in merge_ready - Worked on #17242 specifically the client introduction code. Out of this work, #22781 was borned and I finalized that branch this morning. - A discussion with asn on engineering details of prop224 including the overlap period and service management of introduction point. - Review some tickets in the review group 19. This week: - Continue forward with service branch merge/review - Keep going on client prop224 implementation (#17242). - I'm on triage/coverity duty this week. We are a month away from our soft deadline to have a working prototype which is not that much so expects LOTS of prop224 on my side in the coming days/weeks. komlo: Last week: - Worked on #22762, will finish this week - Had to deal with a fair amount of work/personal things so focused on that. This week: - Writing a follow up to the Rust team about our next steps, what we need to work out on our end, any ways they can help - Adding logging to Rust protover - Wondering what is the best way to mock in Rust for testing, it would be nice to learn if Servo has any good practices - Look at #22745 isabela: last week: - sent sponsor4 report - sent nick time distribution spreadsheet - met f2f with roger this week: - coordination of nsf reports today and off the rest of the week

1 0

Websites tickets triage - a.k.a. weakly cleanup
by Silvia [Hiro] 30 Jun '17

30 Jun '17

Hi, I'd like to organise a weekly websites component ticket triage. It will be held on #tor-project, ideally in the evenings (UTC speaking). I am thinking to start this coming Thursday (6th of July) at 19.00. If this tentative day and time doesn't work and you would really like to be around for the weekly cleanup, please let me know. Talk soon, -hiro

2 1

meetings and laptops
by S. Banerian 30 Jun '17

30 Jun '17

In view of possibilities of issues with laptops and travel, I was wondering if folks had taken access issues into account in planning meetings. I, for one, likely will not try to take a laptop into the US. Thoughts? stefani

1 0

Notes from June 29 2017 Vegas team meeting
by Karsten Loesing 30 Jun '17

30 Jun '17

Notes for June 29 2017 meeting: Alison: 1) Community Team roadmap progress -- still identifying goals and dependencies for the rest of the year. Main priorities are the dependencies and thinking about better ways to have communication channels with devs. 2) Potential new support hire planning with the comms team and the community team 3) Trusteer and Tor Browser situation -- some Windows 10 users can't open TB with Trusteer (anti-fraud, required by banks) software enabled. Colin is digging into this, hoping to have a full update soon. This issue is making me think broadly about support to developer feedback. 4) Support wiki -- hope to have this out next week. Making final edits, writing blog post now. Roger: 1) I did some of my logistics/bureaucracy stuff this past week, but much remains: SponsorR paper to review, PETS paper to review, Defcon slides to write, three NSF reports to start 2) Membership guidelines discussion is proceeding. I think we're getting good feedback so far, and there is work to be done. 3) Brad, Isa, Shari, are we all set with that government certification thing? 4) If you need a Defcon ticket, I might be able to swing a few. Let me know. 5) I'll be seeing Isabela in person right after this meeting, and probably Alison a bit after that, if you need us to discuss anything. Steph: 1) First more donor-focused email newsletter going out in 1-2 weeks. Working with Giant Rabbit to get set up on CiviCRM; they have to create an unsubscribe capability for sending newsletters. I'm creating the template now. Will start monthly, possibly become more frequent. Will be fed by previously published content: blog posts, jobs, press, events, etc. 2) Will be moving press list to CiviCRM; Giant Rabbit is building out with chosen fields now Nick: 1) Putting out releases this week with fixes for TROVE-2017-006. Affects 0.3.0 and later. TBB releases will be warranted IMO. 2) Wanting to resolve license status of torspec: https://trac.torproject.org/projects/tor/ticket/18788 What to do? Should I grab a copyright person? 3) We're starting a "must have regression tests for bugs" policy; let's see how it goes. Other teams might want to watch and see whether they want one too. 4) Wrt fiscal year closing soon: let's not be quiet if anybody's timesheets/reports are late. Instead let's reach out to them right away, so we don't leave Sue & Brad hanging. 5) Should I approve timesheets? How? 6) Working on getting point-of-contact for PT issues. 7) Discussing how we can interact better with external developers/teams who write big patches. Arturo: 1) OONI measurements API now uses as a backend the new data processing pipeline: https://github.com/TheTorProject/ooni-measurements/pull/22 2) Next week we will be making a new ooniprobe mobile release that adds support for sending push notifications to users informing them of things happening in their country/network, asking them to collect more data. Shari: 1) Did some budget work and readjusting expenses based on new fiscal year starting next week. 2) Working with communications team to get our voice right. (nickm offers to help) 3) Back to the drawing board with strategic planners. 4) Working with Erin on updating employment and other Tor policies. 5) Pulling together a team and talking with Giant Rabbit about our end-of-year fundraising plans. Karsten: 1) Released Tor Metrics Library 2, blogged about it, completed Sponsor X award that ends June 30, 2017. Mike: 1) At Mozilla all hands this week. They are excited to work with us. The overall mood seems much more favorable to us than in years past. Isabela: 1) Working on spreadsheet with time allocation for network team and sponsors. 2) Website redesign contract soon coming in for review, to be signed mid-August. Brad: 1) Preparing for year-end close process (fiscal year ends 6/30) 2) Transitioning to new payroll provider for US-based employees effective 7/1

1 0

Is anybody going to Defcon?
by Roger Dingledine 28 Jun '17

28 Jun '17

I'm giving a talk, and I think I can get some of us in for free if I work at it. Let me know if you're a Tor person and you're going and you'd otherwise be needing to pay for registration yourself. --Roger

2 1

GSoC 2017 - unMessage: Report #2
by Felipe Dau 28 Jun '17

28 Jun '17

Hi everyone! This is my report #2 for the unMessage GSoC project. # Updates Since the last report, I mostly worked on the file transfer task (#12) as well as on the logger task (#30). As I intended to implement the file transfer using asynchronous calls, I was able to use the previous work I had done for the asynchronous task (#21) as well as make a few improvements to it. # Deliverables These are the tasks we selected for the first evaluation period: - Improve setup script #35 [0] - Use attrs #34 [1] - Support file transfer #12 [2] - Add a logger #30 [3] These tasks have been finished and their code has been merged to the develop branch [4]. More technical details can be found in the tickets. # What's next The next steps for this second set of tasks are: - Continue making the methods listed in #21 [5] asynchronous - Start writing unit tests for #33 [6] The code for these new tasks can be found in my unMessage fork [7]. Sorry for the delay :/ Thanks, -Felipe [0]: https://github.com/AnemoneLabs/unmessage/issues/35 [1]: https://github.com/AnemoneLabs/unmessage/issues/34 [2]: https://github.com/AnemoneLabs/unmessage/issues/12 [3]: https://github.com/AnemoneLabs/unmessage/issues/30 [4]: https://github.com/AnemoneLabs/unmessage [5]: https://github.com/AnemoneLabs/unmessage/issues/21 [6]: https://github.com/AnemoneLabs/unmessage/issues/33 [7]: https://github.com/felipedau/unmessage

1 0

network team meeting notes, 26 June
by Nick Mathewson 26 Jun '17

26 Jun '17

Hi, all! You can find the transcript from our weekly meeting at http://meetbot.debian.net/tor-dev/2017/tor-dev.2017-06-26-16.59.html Here are our notes: ----------------------- Network team pad, for 26 June Meeting (or 27 June, for those in UTC+5 or later) Notes from last week's meeting: * https://lists.torproject.org/pipermail/tor-project/2017-June/001208.html (Did we do what we had planned?) Announcements and reminders: * review-group-18 is still not cleared. We have 3 tickets left in needs_review there which need to get reviews before nickm makes a review-group-19. * review-group-19 will come once the last 3 tickets in review-group-18 are done. * There are still 34 tickets in 0.3.1.x, including 9 in status "new" with no owner. We need to get 0.3.1.x done! * Employees: remember harvest. [also, if you have pending expense reports, try to submit them before end of june - you can do that via harvest as well if you like] * Isabela will ping people to start collecting information for nsf reports Things we should talk about: * We need a PT person (or at least point of contact) * How important is noise for padding statistics? Mike is thinking "Not very" compared to the type of attack described vs related guard discovery attacks I want to fix first. Tasks for after the meeting: * July team rotation schedule is available at: https://trac.torproject.org/projects/tor/wiki/org/teams/NetworkTeam/TeamRot… teor: Last week: * Fixed a nasty security bug in PrivCount, released 1.0.2, and upgraded all the things * Deployed PrivCount HSDir upload stats on a relay for testing * Looked at all the privcount-tagged trac tickets and updated the PrivCount TODO lists * Tried to help out with the PaddingStatistics implementation #17857 etc. * Stop relays from knowing HS client and service addresses #22688, #22689 * Added a hs-network-min network to chutney: #22667 * Logged a few bugs in Tor and Tor Browser This week: * Document the PrivCount HSDir upload stats test outcomes * Prioritise the remaining 6 hidden service events (HSDir client, HSDir cache evict, Intro service, Intro client, Rend service, Rend client) Mike: Last Week: * Worked on #17857 and #22212. * Discussed padding statistics - I am not seeing this as urgent. * Reviewed #13605 (reduced exit policy option) This Week: * Mozilla all hands, all week... asn: Last week: - Caught up with backlog that accumulated during meeting - Work on prop247 stuff. Started the simulator work: It can currently do a basic prop247 simulation and print out some useful output. - Worked with David on some prop224 stuff - Reviewed some prop224 code and other tickets This week: - Review prop224 groundwork #21979 - Continue prop247 simulation. This week I'll spend debugging, make the compromise adversary models and create some nice graphs. - Update prop224 spec wrt SRV / desc overlap behavior based on discussions with david and the current implementation. - Rewrite the overlap logic of prop224 to use the slot system instead of absolute human times. - Revisit #22006 based on nick/isis review. - Hopefully Write wilmington blog post if I get the time. haxxpop: Last week: - Finished reviewing asn's client-side descriptor fetch code. He replied and I also did reply back :) - Read some lattice-based crypto (as a hobby) This week: - Review dgoulet's load and configure service code #21979 (with asn) - Maybe*, take over Fuzz v3 hidden services #21509 (if it's not done yet) dgoulet: Last week: * DRL meeting on Mon, Tue and Wed. (Nick asks: any takeaway lessons?) * Code review on a couple of hidden service tickets. * We do have #21859 (prop224 e2e code) in needs_review now on Gitlab which is the first ticket in review for prop224 inclusion in 032. * Discussed some action items with asn on prop224 about some intro points engineering issues and overlap period logic that is out of sync in the proposal. This week: * Full throttle prop224 work with splitting the service branch in smaller ones for review and upstream merge. * Continuing and hopefully finishing the client implementation. * July is really our target for a minimally working prop224 for both our sponsors and our Defcon talk (early August). Thus, expect lots of work on that on my part. nickm: Last week: * Thanks to ahf, helped diagnose big regression from prop140 (consensus diff) work: we weren't checking if-modified-since correctly any more! Ahf has a fix; testing again now. * Worked on compression issues that toralf found. * Reviewed lots of code. Merged a bunch. Continued bug triage. * Chased through some contacts to find clarity about copyright status for patches on old ticket from Access Labs. All's well. This week: * Pending isabela, send out notes on Who Works On What Between Now And September. * Circulate "supported platforms list" current draft from https://pad.riseup.net/p/QWpY4UYfAsaK , turn it into a wiki page, pending comment. Any comments? * Review more code * Fix pending 0.3.1.x bugs * Release another 0.3.1.x alpha * Write some stuff for 0.3.2.x * Work on or defer remaining 0.3.1.x tickets * More ticket triage on "unspecified" * Prepare for 0.3.2.x triage. ahf: Last week: Sponsor 4: - Been working on Sponsor 4 measurements with Nick: Looks good for clients so far, but we have regressed badly for relays. We think we know what the primary cause is (see #22702). - Been working on a fix for bug #22702 (Never send a consensus which the downloader already has). - Wrote a script to collect directory measurement from Tor logs. Can be found in ahf/tor-sponsor4-compression on GL.com - Working with Nick on the initial results: data in https://people.torproject.org/~ahf/sponsor4/ - Code review: #22719, #22502 (and thus #22626 + #22628), #22629 Misc: - Code review: #3056 This week (ordered): - Land fix(es) for #22702 after we have confirmed they work. - Land fix for the issue where a relay gets killed by the sandbox because we allocate a little bit over 16 MB memory. - Actually get around and finish the merge of prop #278 that I've kept postponing. - Help out with 0.3.1 issues - If time allows for it: write down a short text that tells the progress we have made with the sponsor 4 work (?) catalyst: Last week: * Reviewed a lot of review-group-18 and 0.3.1 tickets * Progress on reviewing #7869 * Registered for oniongit This week: * Check #7869 test coverage * Investigate #20532 * Investigate more test-stem issues * Bug triage * Ping komlo about followup from Wilmington testing session * Follow up and review support person hiring stuff * Experiment more with oniongit isabela: last week: - passed on next tasks to invoice for sponsorR to Brad - finally sent sponsor4 may report - working with tommy on modularization SOI - synced with Brad to get the info to build the spreadsheet for network team people's time allocation this week: - still waiting on one spreadsheet from brad to get back with nick on people's time allocation - hope to get that done this week - looking forward to finish a couple of pending tasks: update the brief for tor launcher automation and get an update on user growth strategy out to tor-internal - off on july 4th (national holiday) and july 5th-7th to get some personal stuff done - catch up with hiro on what we discussed in wilmington related to gitlab and trac pastly: Last weekish: - I hope you like documentation. I wrote a bunch - I hope you like tests. Did those too Time weekish: - nickm asks: "how is the permission-to-release coming?" - pastly says: no news. Was told it would take ~4 weeks about ~2.5 weeks ago - but plans on sharing with dgoulet and anyone that asks nicely ASAP - Finish fleshing out KIST tests. Main one remaining is for the scheduling loop - Once done fleshing out, will push to oniongit and ping dgoulet to make time for meeeeee isis: Last week: * code review on #22006 and #13703 * small patch for #4019 * did employment/insurance/tax paperwork * answering questions and comments for the internship post This week: * Expenses for amsterdam (!), seattle, and wilminton * Lay out tickets for tasks in the next couple months and figure out sponsors and timelines * Some meetings for Mozilla All-Hands that I should attend * BBC Radio interview * Start setting up backend stuff for moat since I believe the TB Team needs it soon(anything else that is higher priority?) [isa: I think for now this is it. like we chated TB team in august: https://storm.torproject.org/shared/pdwxRlkwBXvDC2SFqB8oFWpiu7RQx1wu0FTcIFw…] * Review the internship applications and narrow down the choices and pick one and get them started * Email to Rust team about where we're at * Email to oxidators about steps moving forward and tasks we need to assign ourselves

1 0

Core Tor team sponsor4 May report
by isabela 23 Jun '17

23 Jun '17

Core Tor team May 2017 report In May we released Core Tor 0.3.0.6 stable, our first stable release on the 0.3.0 series. [1] We also spend sometime organizing a team face to face meeting for June (Network Team Hackfest). This is part of an effort to give teams more opportunities to work face to face beyond our bi-annual meetings. We will be sharing more updates from this gathering on our blog. As part of proposal 140 we merged a GSoC project (#13339) [2] that created consensus diffs, done two years ago, and which will be of greater utility now with proposals 140 and 274-278. For that we had to do some update in the code and add more tests, here is the full list of tasks to add this project to our code base: * #21643 Extract, test, revise, and clean the diff code [3] * #21644 Fuzz the diff and patch code [4] * #21647 directory caches cache multiple past diffs or consensuses [5] * #21648 Caches generate diffs as appropriate [6] * #21649 Caches serve diffs on request [7] * #21650 Clients request diffs and handle diffs in replies [8] * #21673 Handle signatures correctly [9] * #22143 Implement May 3 updates to diff format in prop140 [10] * #22148 conformance to proposal, unhandled corner cases [11] * #22149 Update dir-spec with prop140 protocols [12] We are finished writing and testing proposal 278, and its relevant portions are now merged into dir-spec.txt (#22275) [13]. Tickets related to this effort: * #21664 - Prop278: Make the current 'torgzip' module a submodule of a new 'compression' module [14] * #21662 - Prop278: Add support for LZMA2 and/or Zstandard [15] * #21663 - Prop278: Refactor the torgzip module to support additional compression schemes [16] * #22066 - Prop278: Add memory measurement code in LZMA and Zstandard compression backends [17] * #22085 - Prop278: Refactor and simplify compression tests [18] * #21665 - Prop278: Establish an upper-bound for LZMA2 memory usage [19] * #21667 - Prop278: Handle new headers in directory.c [20] * child-tickets: * #21668 - Prop278: Update cached_dir_t and related types to no longer assume single compresison method [21] * #22065 - Prop278: Parse the Accept-Encoding header and pass it to "get" handlers [22] In June, we will be testing the merged code further, evaluating its performance, and fixing any bugs we find. [1] https://blog.torproject.org/blog/tor-0306-released-new-series-stable [2] https://trac.torproject.org/projects/tor/ticket/13339 [3] https://trac.torproject.org/projects/tor/ticket/21643 [4] https://trac.torproject.org/projects/tor/ticket/21644 [5] https://trac.torproject.org/projects/tor/ticket/21647 [6] https://trac.torproject.org/projects/tor/ticket/21648 [7] https://trac.torproject.org/projects/tor/ticket/21649 [8] https://trac.torproject.org/projects/tor/ticket/21650 [9] https://trac.torproject.org/projects/tor/ticket/21673 [10] https://trac.torproject.org/projects/tor/ticket/22143 [11] https://trac.torproject.org/projects/tor/ticket/22148 [12] https://trac.torproject.org/projects/tor/ticket/22149 [13] https://trac.torproject.org/projects/tor/ticket/22275 [14] https://trac.torproject.org/projects/tor/ticket/21664 [15] https://trac.torproject.org/projects/tor/ticket/21662 [16] https://trac.torproject.org/projects/tor/ticket/21663 [17] https://trac.torproject.org/projects/tor/ticket/22066 [18] https://trac.torproject.org/projects/tor/ticket/22085 [19] https://trac.torproject.org/projects/tor/ticket/21665 [20] https://trac.torproject.org/projects/tor/ticket/21667 [21] https://trac.torproject.org/projects/tor/ticket/21668 [22] https://trac.torproject.org/projects/tor/ticket/22065

1 0