- tor-dev - lists.torproject.org

Orbot makefile / build update
by Nathan Freitas 09 May '12

09 May '12

Since the dawn of Orbot, way back in 2009, the onion routing robot app has been built using an unwieldy combination of tools, based on an extremely out of date method for cross-compiling C code for Android/ARM. In the 1.x era of Android, there was no Native Development Kit as their is now, but thanks to some craft individuals, scripts were developed to utilize the compilers found within the core Android OS build kit. However, this mean you had to build the entire Android OS to be able to build Orbot, and you were potentially relying upon highly unstable internal libraries. This week, I finally bit the bullet, and decided to rewrite the build process utilizing the more proper NDK tools, as well as utilize Git submodules as a means for managing retrieval and version control of dependencies. With the help of _hc, sebastian, rransom, vapourEyes, asn and others, I was able to work through the various issues of porting over to the more limited NDK environment, and come out with a properly formatted Makefile for building all native code that Orbot relies upon. This means that to fully build Orbot (including tor, privoxy, and obfsproxy binaries, and the jtorctrl java library) you simply need to ensure you have the Android SDK and NDK setup, and then: 1) git clone git://git.torproject.org/orbot.git 2) cd orbot 3) make -C external 4) android update project --name Orbot --target android-15 --path . 5) ant debug That's it! (in theory). At this point, I would love some clean eyes to look at this, try it out, ask questions and who knows, perhaps submit a patch or two. Human readme on new build process and prereqs: https://gitweb.torproject.org/orbot.git/blob/HEAD:/BUILD Makefile for Orbot and dependencies (openssl, libevent, privoxy, obfsproxy) https://gitweb.torproject.org/orbot.git/blob/HEAD:/external/Makefile Successfully executed build on our build server: https://build.safermobile.org/job/Gibberbot/49/console happy friday, n8fr8

2 2

Win32: tor-gencert.c
by Gisle Vanem 07 May '12

07 May '12

MSVC doesn't have <unistd.h>. Hence this little patch is needed: --- Git-latest\src\tools\tor-gencert.c Tue Jan 24 17:05:52 2012 +++ src\tools\tor-gencert.c Thu Apr 26 08:51:02 2012 @@ -9,7 +9,9 @@ #include <sys/types.h> #include <sys/stat.h> #include <fcntl.h> +#ifdef HAVE_UNISTD_H #include <unistd.h> +#endif #include <openssl/evp.h> #include <openssl/pem.h> --------------- --gv

2 1

TorBrowser and Firefox ESR
by Jérémy Bobbio 07 May '12

07 May '12

Hi! (I tried to ask the question to Mike Perry on IRC but I am not sure that it was the best place to do so, also given that my proxy had connectivity issue yesterday. If someone have already answered me there, I apologies for wasting a little bit of your time, but I did not receive the reply.) It looks like Firefox maintainers in Debian have decided to ship Extended Support Releases in the upcoming Wheezy release. This made me wonder if ESR changed any plans concerning TorBrowser. Will Tor Browser Bundle keep following upstream "personal use" releases or switch to ESR? Cheers, -- Jérémy Bobbio .''`. lunar(a)debian.org : :Ⓐ : # apt-get install anarchism `. `'` `-

2 2

Re: [tor-dev] tbb-build for Windows
by John Crain 06 May '12

06 May '12

Hi Shondoit, Thanks for taking time! > If you have a clean VM, with a default install of Windows 7, then please try it out and > let me know. If you have a dirty Windows XP in the back of your closet, try it out > as well. I'd love to hear how it breaks and then improving it. Would you be interested in the opposite? That is, a (slightly) dirty default install of Windows 7 (x64), and a clean VM with a default install of Windows XP SP3? Alternatively, I could install XP into a new partition on HDD, if you'd prefer. > Don't forget to set-up Git (git config [...]), clone torbrowser.git, > add my personal repo, checkout 'personal-build' Could you please expand on this? I haven't used Git via mingw and I don't much feel like taking the time to RTFM ;) P.S. How would one go about using your work for profile build(s) to test benefits of something like [0,1]? [0] #3978: "Better TBB about:config settings(?); re: browsing and loading speed, etc." https://trac.torproject.org/projects/tor/ticket/3978 [1] https://trac.torproject.org/projects/tor/attachment/ticket/3978/tbb-ff-pgo.… -- John Crain johncrain(a)eml.cc -- http://www.fastmail.fm - A fast, anti-spam email service.

2 3

Win32/MSVC: tinytest.c problems
by Gisle Vanem 06 May '12

06 May '12

There are 2 problems with the use of 'stricmp()' (line 295) in tinytest.c. 1. As it is now, I'm getting an undefined reference to 'stricmp' when linking tinytest.exe and using '-nodefault:oldnames' in the link-flags. Can we please remove this lib from the requirements? 2. 'stricmp()' is used nowhere else in Tor. But rather 'strcasecmp()'. Can we use that for consistency instead? Need to include "or.h" to include src/compat.h. Like the lines from src/compat.h says: /* Windows names string functions differently from most other platforms. */ #define strncasecmp _strnicmp #define strcasecmp _stricmp How about this little patch: --- ..\..\Git-latest\src\test\tinytest.c Wed Mar 21 10:16:58 2012 +++ tinytest.c Fri May 04 14:07:55 2012 @@ -22,6 +22,9 @@ * (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF * THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. */ + +#include "or.h" + #ifdef TINYTEST_LOCAL #include "tinytest_local.h" #endif @@ -292,7 +295,7 @@ #ifdef _WIN32 const char *sp = strrchr(v[0], '.'); const char *extension = ""; - if (!sp || stricmp(sp, ".exe")) + if (!sp || strcasecmp(sp, ".exe")) extension = ".exe"; /* Add an exe so CreateProcess will work */ snprintf(commandname, sizeof(commandname), "%s%s", v[0], extension); commandname[MAX_PATH]='\0'; ----------------- There are more MSVC-issues in other test/*.c files. I can get back to that. --gv

2 2

tbb-build for Windows
by Shondoit Walker 06 May '12

06 May '12

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The last couple of days I've been working on recreating my build environment. I remember from the last time that it was a major PITA. (Especially with outdated docs, that aside) I decided to automate as much as possible and I came up with the following bootstrapper. It's a minimal bundle and contains 7zip and mingw-get needed to completely deploy everything. How it works is like follows: The user downloads and extracts the package to C:\MinGW (for example) Then double-clicks '.\install.cmd' and the process starts. It will first copy the files to the necessary places and then runs mingw-get to retrieve all packages. After that it downloads and unpacks MsysGit (Yes, it integrates git into mingw ;) It downloads and unpacks CMake and lastly it sets some default settings to integrate msysgit features into mingw, like git auto-completion. Note that the entire thing is self-contained. It installs nothing. For now, the user still needs to download the following manually, but they can use the default install locations: Qt, MSVS C++ Express, WinSDK 7.0, DirectX SDK I could only use sha1sum for msysgit because it's the only one that offers it. mingw-get might use hashes internally. This entire process differs none from manually downloading all packages in terms of integrity checking. I'm not sure where I was going with this lil' project, but personally, I'll keep using it. I just thought sharing it would be a good idea. It might be a step in the right direction for deterministic builds. The source can be found at: https://github.com/Shondoit/tbb-build The latest package can be downloaded from: https://github.com/downloads/Shondoit/tbb-build/tbb-build-1.2.1.zip Extract it to C:\MinGW and run install.cmd, after it's finished you can start mingw with start.cmd If you have a clean VM, with a default install of Windows 7, then please try it out and let me know. If you have a dirty Windows XP in the back of your closet, try it out as well. I'd love to hear how it breaks and then improving it. Note: you need to use my 'personal-build' branch from my personal tpo repo since the latest patches have not been merged yet. And you need to install Qt, MSVC, WinSDK and DX SDK, found here: http://releases.qt-project.org/qt4/source/qt-win-opensource-4.8.1-mingw.exe http://download.microsoft.com/download/A/E/7/AE743F1F-632B-4809-87A9-AA1BB3… http://download.microsoft.com/download/A/5/4/A54BADB6-9C3F-478D-8657-93B3FC… http://download.microsoft.com/download/7/A/B/7ABD2203-C472-4036-8BA0-E50552… Qt needs to be installed /after/ tbb-build finished completely. Don't forget to set-up Git (git config [...]), clone torbrowser.git, add my personal repo, checkout 'personal-build' And then the following should Just Work*?*: $ make -f build-scripts/windows.mk build-all-binaries bundle Good luck, Thanks, And regards, Shondoit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQEcBAEBAgAGBQJPpdGcAAoJEPkeD+x3AmlW2h0IAJBDV96W/ttwW/AlGJqNhbWB Qjqz23ToX9oIhm4S3XVJ4UmnrBSMbgG611+aFVl1BRieOTCaaCNFZADF9YUrunex dXPI0v+MhLu31Lc/yjIA8wbf8lhKQT35nLn4SQLG6lKV9tbxZYSIkNsYB4oVzLXr 9n512ILU48t8E4yZzobsqdJEvgW89V91tG6nPoW27oDJnG9vvU6c93yLVAZhCtgK TMRGa48Vvw+vyC+Gr5XMYEMD3D4LB7jpf3yIrd7USKGDrrgRAXn+av6PYLxmizhV GlCD+PYjcaCIx1CO+gK5UnuZfEQUFXuQAvtw+unXVVDq1oHb7lMYpkOpcUt1BPA= =tpTj -----END PGP SIGNATURE-----

1 0

Re: [tor-dev] [tor-assistants] Python metrics-lib
by Karsten Loesing 06 May '12

06 May '12

[Moving this thread to tor-dev as suggested by Damian in separate mail.] Hi Damian, hi Beck, On 5/4/12 6:59 PM, Damian Johnson wrote: > Hi Beck. > >> I noticed that stem has not been updated during the last ten days > > Yup, I've been busy for a while with a new arm release [1] and a > variety of other chores. Ravi is currently working on safe cookie > support and I'll be getting back into stem development this weekend. > >> it's a good time to start doing some substantial work > > Great! > >> So for me, a reasonable next step is to build some subclass on top of the base Descriptor class. What do you think? > > Sounds good. What descriptor type would you like to tackle first? > Karsten, do you have any suggestions? Ravi plans to do network status > entries and microdescriptors so I'd suggest something besides those. There are quite a few options. How about extending stem to implement #2768? There's already Java code for verifying server descriptors and consensuses in metrics-tasks.git [0]. On stem's side this requires parsing the crypto parts of server descriptors, consensuses, and certificates. If the network statuses aren't there yet, starting with server descriptors should be fine. And once there's verification code for server descriptors and consensuses, there are more things to verify in Tor's various descriptors. Another option would be to write the parsing code for extra-info descriptors including all the stats. Once we have consensuses, server descriptors, and extra-info descriptors in stem, we can start writing a Python version of Onionoo [1], the service that provides the data for Atlas [2]. Let me know if you need more options or more input on these. Thanks, Karsten [0] https://gitweb.torproject.org/metrics-tasks.git/tree/HEAD:/task-2768 [1] https://www.torproject.org/projects/onionoo.html.en [2] https://atlas.torproject.org/ > Also, since you're interested in this area I'd suggest giving this a read... > https://trac.torproject.org/projects/tor/ticket/5651 > > There's nothing that needs to be done for it on our end at the moment > - just related to the stem/metrics-lib work. > > Cheers! -Damian > > [1] https://blog.torproject.org/blog/arm-release-145 > > On Fri, May 4, 2012 at 9:32 AM, Beck Chen <csybeck(a)gmail.com> wrote: >> Hi Damian, >> >> Greetings! I've read through the metrics-lib and stem.descriptor code and >> skimmed the directory server specs since you sent me the discussion thread >> between you and Karsten. I noticed that stem has not been updated during the >> last ten days, and since I've finished my semester and gone back to China, >> it's a good time to start doing some substantial work. >> >> In stem.descriptor, we already have counterparts for Descriptor.java, >> DescriptorReader.java, and ServerDescriptor.java now, and as you mentioned, >> they pretty much behave in the same way. So for me, a reasonable next step >> is to build some subclass on top of the base Descriptor class. What do you >> think? I believe you have discussed this with Karsten, so it will be helpful >> if you can forward me some of your discussions. >> >> Beck

2 1

[GSoC] Greetings!
by Ravi Chandra Padmala 28 Apr '12

28 Apr '12

Hello everyone. I'm Ravi Chandra Padmala (aka neena). I'm an undergraduate student at GITAM University in Visakhapatnam, India. I've been a user of open source software for 6 years now. My go-to programming language is usually python. I have tinkered with a few other languages, and I try my best to be programming language agnostic, I will be working on Stem this summer (as a part of the Google Summer of Code program). Damian (atagar) is my primary mentor. Among other things, I'll be implementing the general controller class for Stem. If anyone is interested in exactly what I'm going to be working on, do take a look at my proposal which is available here[1]. If anyone needs to contact me, this is my primary email. I'm 'neena' on IRC (irc.oftc.net) I'm geographically located in GMT+5:30. (Though, my body clock is in GMT-1). -- Cheers, neena [1] https://www.torproject.org/about/gsocProposal/gsoc12-proposal-stemImproveme….

1 0

New from GSoC
by 九零后 28 Apr '12

28 Apr '12

Hi, I come here from GSoc and want to join project Obfsproxy. But I can't find the contributors' mail , where can I get it?

2 1

[Patch] test_util.c with MSVC
by Gisle Vanem 26 Apr '12

26 Apr '12

The src/test/test_util.c doesn't compile with MSVC (CL ver. 16.00.30319.01). It doesn't like the "#ifdef 0" construct, but the whole chunk should be enabled with some modifications IMHO. 'path_is_relative()' doesn't handle the "http:\\dir" case though. Why should it? Besides 'expand_filename()' isn't for Windows. I suggest this patch: --- Git-latest\src\test\test_util.c Fri Apr 06 22:45:14 2012 +++ src\test\test_util.c Thu Apr 26 08:59:18 2012 @@ -1526,10 +1526,6 @@ /* Windows */ #ifdef MS_WINDOWS - /* I don't have Windows so I can't test this, hence the "#ifdef - 0". These are tests that look useful, so please try to get them - running and uncomment if it all works as it should */ -#ifdef 0 test_eq(1, path_is_relative("dir")); test_eq(1, path_is_relative("dir\\")); test_eq(1, path_is_relative("dir\\a:")); @@ -1538,8 +1534,7 @@ test_eq(0, path_is_relative("\\dir")); test_eq(0, path_is_relative("a:\\dir")); test_eq(0, path_is_relative("z:\\dir")); - test_eq(0, path_is_relative("http:\\dir")); -#endif + test_eq(1, path_is_relative("http:\\dir")); /* path_is_relative() doesn't test for such */ #endif done: @@ -2887,7 +2882,9 @@ UTIL_LEGACY(config_line_quotes), UTIL_LEGACY(config_line_comment_character), UTIL_LEGACY(config_line_escaped_content), +#ifndef MS_WINDOWS UTIL_LEGACY(expand_filename), +#endif UTIL_LEGACY(strmisc), UTIL_LEGACY(pow2), UTIL_LEGACY(gzip), With the above, test/test.exe now says: util/path_is_relative: OK --gv

3 2