- tor-dev - lists.torproject.org

Searchable Tor descriptor and Metrics data archive - GSoC 2013
by Praveen Kumar 16 Apr '13

16 Apr '13

Hi, I am Praveen Kumar from India. I want to work on the project "Searchable Tor descriptor and Metrics data archive". I have participated in the past instances of GSoC with Melange and e-cidadania, and have an extensive experience in development with Python. For the search application, I propose using Django with MongoDB as a NoSQL database backend for our search application. We have 100GB+ of data which eventually grows everyday and so using a NoSQL backend will ensure us that our application scales well with the increase in data as well as user traffic. The application will have various interfaces such as: 1) Data Updator: This end will connect and retrieve data from the metrics website periodically via rsync. It will also be responsible for pre-processing the data to a suitable format as our search application needs. 2) Storage End: A relay descriptor can be searched by nickname, fingerprint, IP Addr and various other attributes that define a relay descriptor. So we can preprocess the whole data, extract the attributes that define a descriptor and then save it in an appropriate model MongoDB provides. Since queries are very fast in a NoSQL datastore, our searches will be very fast. 3) Search Front End: This will be exposed to the user where a user provides its search query to us. 4) Search query processor: This end will process the query of a user and determine its type for eg. whether the query is an IP Address or a nickname etc. It will then connect with our Storage End and return the appropriate data to the Search Front End. Above is a very high level view of my approach to this project. We can also use Django Haystack as a search application framework(I did some research for existing search frameworks). I can implement this app in an object oriented way in Python. Python being such a beautiful and easy to understand language, it will be easy for others to understand and make changes to the application in least amount of time. I would like to know if I am thinking in the right direction and would like to know what Karsten has to say about this. - Cheers Praveen

2 3

Re: [tor-dev] Tor trademark (was Embedding tor in an application and using tor) without opening a port
by wac 16 Apr '13

16 Apr '13

Hi Roger: On Mon, Apr 15, 2013 01:04 EDT Roger Dingledine wrote: >> I changed from libTor to libtor as Tor is a registered trademark but >>lowercase tor is not. > >I'm afraid that's not how trademark works. The trademark is infringed by >any name that might confuse users into thinking that it is, represents, >or is endorsed by the Tor Project. The confusion argument is not based in any facts for instance like statistics. I can also think a zillion words that have tor as part of their names. Fine is there a name I could use to reference Tor network and nothing else but that network without using the name Tor or any other "trademark"? >> I already paid for the domain and to make sure people knows is a library >>to use the Tor network. > >I would be happy to paypal (or whatever) you some money to register a >different domain -- e.g. libonion.org -- before you get too established >in your brand. Well is not a wrench thrown like before. Thanks I appreciate it. In any case is not a brand just a name. I would however redirect in such case libtor.org explaining this change to such new domain as some people already knows it. A change has benefits as gives me more freedom to operate. At least removes the commercial exploitation lock. > >(Many generic Tor-related projects use the community-oriented word >'onion', which we have intentionally left out of all our trademarks.) > IMHO onion is far from specific and is confusing. It could be anything. I mean what would someone who have no idea of what is Tor or onion *routing* would think it is? >> This is also non-profit and I clarified at the website what is Tor and >>that carries no guarantee from the Tor Project about quality, suitability >>or anything else. > >Thanks -- that is a good first step. > >> The guidelines also say that being non-profit I could >>even use a modified Tor logo. > >Actually, that's not what the guidelines say. They say "Please don't >modify the design or colors of the logo." Can you point to the sentence(s) >that confused you, so we can clean them up? I double checked, yes. This one "If you're making non-commercial use of Tor software, you may also use the Tor onion logo" The confusion source seems to be the first clarification inside the parenthesis as the meaning changes when you remove it. "If you're making non-commercial use of Tor software, you may also use the Tor onion logo. Please don't modify the design or colors of the logo. You can use items that look like the Tor onion logo to illustrate a point, so long as they're not used as logos in ways that would confuse people." What I interpret here now is that I can use it if I am non-commercial as long as I don't modify design or colors. "Confuse people" is subject to open interpretation too. >> This is in any case not a trademark, is just a name so people knows >>what they are getting that comes out almost naturally. A library to >>connect to the Tor network. > >You're making modifications to Tor, Correct >and then telling people what they're >getting is Tor. Where? No, never claimed that. >I'd say that's a clear opportunity for confusion. There is absolutely no intention of causing confusion. >> I do not pretend to sell anything. But I >>made it lowercase however in order to reduce any possible tension. > >I understand, and that's why it would be best to resolve the confusion >early before users start to associate your software with this name. Ok looking forward to remove the "source of confusion". I still don't think it is. >In fact, I'd love to have an officially associated project, called >something like libtor, that is a library version of the Tor software, >endorsed and maintained by Tor (including maintained by you as a Tor >project core member). But the way to get there is to become a part >of the Tor community and establish a history of doing development and What would be the exact measurement parameter/s to make this move? And what would this mean? I would not like to be changing names back and forth so I would like to keep it. Changing it is problematic to users and the project itself as would take established users away. Basically what I am looking is to satisfy my own needs and maybe get help from the community. So I would like it to be used. I would like to innovate at some point in the future too. I have some ideas in several aspects. >maintenance of libonion the right way, What is the precise meaning of "right way" here? Sorry is not clear to me. >rather than to start out with a confusing name So far no visitors have showed any sign of confusion. They all know is a modification of Tor. >and hope everything works out from there. I will find roadblocks for sure. Well I've being getting some already. I am not the kind who steps back easily in front of them. Things will work. I've being developing/fixing bugs in software for years: http://www.reactos.com/wiki/ChangeLog-0.2.1 http://aircash.sourceforge.net/zerodaypatches.html I know nobody knows me here but assuming that anybody new around is going to provide something broken or low quality doesn't seems to me a good approach. Fine I do not pretend to be trusted right away or change ppl way of doing things. This is something I want to use myself. I am not looking to blow my own feet. Fine I could do it unintentionally as everybody can make mistakes. That's why I am looking to open it and looking to get it used because of the peer review. > >> Is >>not that I have to obey any law from the USA as they don't apply to me. > >I'm afraid that part isn't true either in this case -- you got your >domain from a US-based TLD, and through an ICANN-accredited registrar, >so both US trademark law and the UDRP apply. Do a web search for 'icann >udrp' for the gritty details. I have not waved any fist. Yes I used a USA owned TLD in order to follow the netiquette. As a matters of fact is the most non-profit way I could do it. I am not looking for any trouble, but this kind of things... well. I feel tension. In any case all that could happen here is ICANN cancelling the domain at some point maybe which doesn't stops me from using the name per se. In front of litigation a judge from the USA would fail in favor of anything US based no matter what. Ok as I said earlier I am not looking to cause any confusion or any tension. I am not looking to use that precise name or infringe any trademark. And still think is fair use. In any case I would really like to use a precise and descriptive name for the library if you feel uncomfortable with that one. Regards Waldo

1 0

Re: [tor-dev] Embedding tor in an application and using tor without opening a port
by wac 15 Apr '13

15 Apr '13

Hi Nick: I changed from libTor to libtor as Tor is a registered trademark but lowercase tor is not. I already paid for the domain and to make sure people knows is a library to use the Tor network. To name that sort like Silvertunnel is actually a deformation caused by fear of this policy that causes confusion among users that IMHO is causing problems at the Tor community. I am not a lawyer but even if it were I consider is pretty much fair use same way as Winrar, Winzip or Winamp are trademarks that use part of a brand from Microsoft Corp. to let know persons the software targets the Windows platform. This is also non-profit and I clarified at the website what is Tor and that carries no guarantee from the Tor Project about quality, suitability or anything else. The guidelines also say that being non-profit I could even use a modified Tor logo. I won't, but obviously I have absolutely no intentions of damaging any trademark or confuse anyone. This is in any case not a trademark, is just a name so people knows what they are getting that comes out almost naturally. A library to connect to the Tor network. I do not pretend to sell anything. But I made it lowercase however in order to reduce any possible tension. Is not that I have to obey any law from the USA as they don't apply to me. I perceive some ppl doesn't likes the idea. Some others do. Well ok is a diverse world, I do not pretend everyone to see it same way I do. Regards Waldo ------------------------------ On Sat, Apr 13, 2013 16:05 EDT Nick Mathewson wrote: >> On Apr 13, 2013 1:42 PM, "wac" <waldoalvarez00(a)yahoo.com> wrote: >> > >> > >> > Seems you want to put your hands at it so that makes two of us. You >don't need to do what I already did. I am preparing the environment to move >towards team mode. Check the website http://libtor.org. > >This name is likely to be a problem with our trademark policy. Please read >the policy, and consider a rename. > >-- >Nick

2 1

Re: [tor-dev] Embedding tor in an application and using tor without opening a port
by Nick Mathewson 13 Apr '13

13 Apr '13

> On Apr 13, 2013 1:42 PM, "wac" <waldoalvarez00(a)yahoo.com> wrote: > > > >> > > Seems you want to put your hands at it so that makes two of us. You don't need to do what I already did. I am preparing the environment to move towards team mode. Check the website http://libtor.org. This name is likely to be a problem with our trademark policy. Please read the policy, and consider a rename. -- Nick

2 1

Re: [tor-dev] Embedding tor in an application and using tor without opening a port
by wac 13 Apr '13

13 Apr '13

Hi Navis: Good to hear you built it. I have a working library with a defined API but is not re-entrant. It can connect with a server over Tor circuits and transmit/receive data but nothing is re-entrant at all. So the same Tor thread must be used for all of that ATM. I can fetch webpages like that however and can also do some limited chit-chat over IRC. I attempted to add some locking to some of the data structures but that is insufficient. For instance lists and buffers. Hash tables are complex. They are defined with some macros in order to make them generic overcoming some limitations of C language but they are less than maintainable IMHO. So I was thinking to replace them with another one already built with a similar license but re-entrant. Found a very good one. I have a couple of ideas to make it usable before that happens however. Seems you want to put your hands at it so that makes two of us. You don't need to do what I already did. I am preparing the environment to move towards team mode. Check the website http://libtor.org. In any case remember all of this to make it solid is not just about coding. Regards Waldo ------------------------------ On Thu, Apr 11, 2013 21:29 EDT Navin Francis wrote: >I managed to build it with MSVC after tinkering with the code a little. Did >you guys make any progress in making tor a library? It seems like I can >directly call functions like handle_getinfo_helper in control.c to control >tor. > >//application_main.cpp >//Application that starts tor in a new thread in the same process >#include <future> >#include <iostream> >#include "libtor.h" >using namespace std; >int main(int argc, char *argv[]){ >auto tor_return=async(launch::async,start_tor_main,argc, argv); >while (tor_return.wait_for(chrono::seconds(2))!=future_status::ready){ >char *ans; >const char *errmsg; >handle_getinfo_helper(NULL, "config/names", &ans, &errmsg); >cout<"application is running! ["<ans<"]"<endl; >} >return tor_return.get(); >} > >//libtor.h >//Duplicates the definitions in Tor. If there is a way around this, do >tell! :) >extern "C"{ >int start_tor_main(int argc, char *argv[]);//Tor's main() is renamed to >start_tor_main >int >handle_getinfo_helper(void *control_conn, >const char *question, char **answer, >const char **err_out); >} > >It seems like handle_getinfo_helper is called asynchronously by tor >whenever a GETINFO is recieved on the control port so I don't need >locking/synchronization. Can someone confirm this? > > >On Sun, Apr 7, 2013 at 4:40 AM, Gisle Vanem <gvanem(a)broadpark.no> wrote: >> >> I didn't read the original messege on this, but you have problem building >> Tor and it's libs using MSVC? If so, >> you could try my "GNU make" based system for MingW + >> MSVC here: >> http://home.broadpark.no/~**gvanem/misc/#tor<http://home.broadpark.no/~gvanem/misc/#tor> >> http://home.broadpark.no/~**gvanem/misc/tor-windows.zip<http://home.broadpark.no/~gvanem/misc/tor-windows.zip> >> >> I just tested it with today's Tor Git-repo. And it works for me. >> >> --gv >>

2 1

Re: [tor-dev] [tor-relays] BitTorrent complaint
by grarpamp 12 Apr '13

12 Apr '13

Swiped from the 'BitTorrent complaint' thread over on relays... > If an exit relay then drops that > connection silently, Tor (and the user) cannot know it needs to select a > different exit. The connections simply fail. > ... > What you do with that iptables rule (or similar rules) is block a bunch > of URLs. There may be room to take and work this capability further... Instead of populating the directory with the actual exit policies, offload this into a client poll of a set of live exits the client wishes to queuing up for rotation into for common ports, or even ports it's recently seen in use. Plus a general random poll to ensure N number of exits are held that will be able to service the full matrix of 65536 ports M-times redundantly, sortof like tor_exitlist.py function. Then like Tor transparent proxy to the host's packet filter, there can be a way the exit can read, API, or be fed the host's current rules to then be polled for it by the client. Plus an expected ruleset lite/timeout value. Users of custom policies would need to use separate rule tables, interfaces, or be smart about about any sensitive rule data if they care. Directories would still carry all exits. But only predefined policies efficiently marked by an 8 bit label. 0) non-exit 1) fully open 2) pollme 3) reduced 4) std set A 5) std set B, etc. Client releases hold the policy label map, including revoked and reserved label definitions. Or the map can be held in realtime dht or alikes.

1 0

Re: [tor-dev] Embedding tor in an application and using tor without opening a port
by Navin Francis 12 Apr '13

12 Apr '13

I managed to build it with MSVC after tinkering with the code a little. Did you guys make any progress in making tor a library? It seems like I can directly call functions like handle_getinfo_helper in control.c to control tor. //application_main.cpp //Application that starts tor in a new thread in the same process #include <future> #include <iostream> #include "libtor.h" using namespace std; int main(int argc, char *argv[]){ auto tor_return=async(launch::async,start_tor_main,argc, argv); while (tor_return.wait_for(chrono::seconds(2))!=future_status::ready){ char *ans; const char *errmsg; handle_getinfo_helper(NULL, "config/names", &ans, &errmsg); cout<<"application is running! ["<<ans<<"]"<<endl; } return tor_return.get(); } //libtor.h //Duplicates the definitions in Tor. If there is a way around this, do tell! :) extern "C"{ int start_tor_main(int argc, char *argv[]);//Tor's main() is renamed to start_tor_main int handle_getinfo_helper(void *control_conn, const char *question, char **answer, const char **err_out); } It seems like handle_getinfo_helper is called asynchronously by tor whenever a GETINFO is recieved on the control port so I don't need locking/synchronization. Can someone confirm this? On Sun, Apr 7, 2013 at 4:40 AM, Gisle Vanem <gvanem(a)broadpark.no> wrote: > > I didn't read the original messege on this, but you have problem building > Tor and it's libs using MSVC? If so, > you could try my "GNU make" based system for MingW + > MSVC here: > http://home.broadpark.no/~**gvanem/misc/#tor<http://home.broadpark.no/~gvanem/misc/#tor> > http://home.broadpark.no/~**gvanem/misc/tor-windows.zip<http://home.broadpark.no/~gvanem/misc/tor-windows.zip> > > I just tested it with today's Tor Git-repo. And it works for me. > > --gv >

1 0

(Py)Obfsproxy Debian packages
by George Kadianakis 11 Apr '13

11 Apr '13

Greetings (Debian) people, we have decided to keep the Obfsproxy name and simply replace the old C codebase with the new Python codebase. It seems that 'obfsproxy' is an extremely powerful brand name and changing it will result in user confusion. That said, what is the best way to update the Debian packages so that they contain the Python codebase? I remember weasel telling me that updated packages can only be included in Debian after wheezy is stabilized. Can we have Python Obfsproxy packages in deb.torproject.org in the meantime? Lunar, how did the Debian package creation go? Do you need any help? We should name the new packages 'obfsproxy'. (Sorry for the duplicate mail, but I forgot to CC tor-dev in the previous one.)

3 7

Building Tor on OS X with brew fails
by Bernard Tyers - ei8fdb 11 Apr '13

11 Apr '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi there, I just tried building Tor with brew on OS X (10.6.8) using the instructions available on the TP website ( ). It fails at the last few steps complaining of a 404: Homebrew. If formula fail to build uninstall Macports/Fink and reinstall any affected formula. Also installing dependencies: libevent ==> Downloading http://monkey.org/~provos/libevent-2.0.12-stable.tar.gz ######################################################################## 100.0% ==> ./configure --prefix=/usr/local/Cellar/libevent/2.0.12 ==> make install /usr/local/Cellar/libevent/2.0.12: 47 files, 2.0M, built in 66 seconds ==> Downloading https://www.torproject.org/dist/tor-0.2.1.30.tar.gz curl: (22) The requested URL returned error: 404 Error: Failure while executing: /usr/bin/curl -f#LA Homebrew\ 0.8\ (Ruby\ 1.8.7-358;\ Mac\ OS\ X\ 10.6.8) https://www.torproject.org/dist/tor-0.2.1.30.tar.gz -o /Library/Caches/Homebrew/tor-0.2.1.30.tar.gz I can confirm that https://www.torproject.org/dist/tor-0.2.1.30.tar.gz is (to me) a 404. I know I can install TBB but I was curious if this approach also worked. Has the location moved? Thanks. Bernard - -------------------------------------- Bernard / bluboxthief / ei8fdb IO91XM / www.ei8fdb.org -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.17 (Darwin) Comment: GPGTools - http://gpgtools.org iQEcBAEBAgAGBQJRZw0rAAoJENsz1IO7MIrrI+oH/jE6hxAeTb9SD3orihGZ0Hn4 wVxf9MkagvH4aS2Hl33FUycr0liy6JqHxxXa16NjZqAfiuUstvQiEiMWAXah1Oa9 A0qNjNOfnmi0BsxJES4E30e3+MvmGzNw4fLjos6iPk2B/+s5orqSv2cba5iVEwXp 3VsqhFOlugVatI592201K9+tQgl/a1aCXfZnW1t4GFqAIf2ApdoX89cV1l3jqMDP NYOZRaX79FGB7iF+/3SrTKtEwVifjAh/IoCx4cEuVOpGFjFt0Jmkgbd1ThlKYqwn TYLFUdKWhebl1N9v4fjow0sXrXh71g3oBuavX2XA+YFqG/ChBDSFPKzps2JyWIQ= =BiEt -----END PGP SIGNATURE-----

3 3

Fwd: Fwd: Orbot feature for GSoC 2013
by Nathan Freitas 11 Apr '13

11 Apr '13

Is there room for an Orbot developer under Tor's GSoC? I know that I was completely awol during this process, and not a mentor, but this is a worthwhile effort! -------- Original Message -------- Subject: Fwd: Orbot feature for GSoC 2013 Date: Thu, 11 Apr 2013 17:50:26 +0200 From: Pavlos <onexemailx(a)gmail.com> To: nathan(a)guardianproject.info CC: abel(a)guardianproject.info Hello, I talked in #tor-dev and asked about a feature I could implement for Orbot as part of Google summer of code 2013 and abel suggested the implementation of the android 4.x's VPN Service as a way to get rootless transparent torification. I understand this was created https://github.com/guardianproject/OrbotVPN but for some reason couldn't be finished? Is it plausible to implement it? If not maybe there is something else I could make? Some words about me: I'm a CS student at my 5th year. I finished with my courses a year ago and I'm just enrolled because I'm an intern at CERN and have to be a student. My github is here: https://github.com/uberspot/ I have worked previously on two android apps (OpenWifiStatistics that coorelates gps with wifi scan data and AnagramSolver for solving anagrams) and I have another one almost complete (a lan multiplayer trivia game). Kindly awaiting your responce, Paul

3 3