January 2017 - tor-commits - lists.torproject.org

[stem/master] Defer defaulting to speed descriptor parsing
by atagar＠torproject.org 30 Jan '17

30 Jan '17

commit 3eecbe1f5ce468769d5d884172eeca677e2f1b30 Author: Damian Johnson <atagar(a)torproject.org> Date: Wed Jan 25 10:58:50 2017 -0800 Defer defaulting to speed descriptor parsing Defaulting descriptor attributes when they're accessed rather than doing this right away. This speeds reading descriptors with validation by ~25%... Before descriptor.microdescriptor... success (15.38s) descriptor.networkstatus... … [View More] success (23.25s) After descriptor.microdescriptor... success (11.67s) descriptor.networkstatus... success (19.80s) --- docs/change_log.rst | 2 +- stem/descriptor/__init__.py | 48 ++++++++++++++++++++++----------------------- 2 files changed, 25 insertions(+), 25 deletions(-) diff --git a/docs/change_log.rst b/docs/change_log.rst index 477db2e..1111afd 100644 --- a/docs/change_log.rst +++ b/docs/change_log.rst @@ -45,7 +45,7 @@ The following are only available within Stem's `git repository * **Descriptors** - * Sped descriptor reading by ~5% by not cloning immutable fields + * Sped descriptor reading by ~25% by deferring defaulting when validating * Support for protocol descriptor fields (:spec:`eb4fb3c`) * Shared randomness properties weren't being read in votes (:trac:`21102`) diff --git a/stem/descriptor/__init__.py b/stem/descriptor/__init__.py index 67ea374..1262f6a 100644 --- a/stem/descriptor/__init__.py +++ b/stem/descriptor/__init__.py @@ -437,6 +437,15 @@ def _parse_key_block(keyword, attribute, expected_block_type, value_attribute = return _parse +def _copy(default): + if default is None or isinstance(default, (bool, stem.exit_policy.ExitPolicy)): + return default # immutable + elif default in EMPTY_COLLECTION: + return type(default)() # collection construction tad faster than copy + else: + return copy.copy(default) + + class Descriptor(object): """ Common parent for all types of descriptors. @@ -516,21 +525,6 @@ class Descriptor(object): if parser_for_line is None: parser_for_line = self.PARSER_FOR_LINE - # set defaults - - for attr in self.ATTRIBUTES: - if not hasattr(self, attr): - value = self.ATTRIBUTES[attr][0] - - if value is None or isinstance(value, (bool, stem.exit_policy.ExitPolicy)): - pass # immutable - elif value in EMPTY_COLLECTION: - value = type(value)() # collection construction tad faster than copy - else: - value = copy.copy(value) - - setattr(self, attr, value) - for keyword, values in list(entries.items()): try: if keyword in parser_for_line: @@ -654,19 +648,25 @@ class Descriptor(object): if name in ('_lazy_loading', 'ATTRIBUTES'): return super(Descriptor, self).__getattribute__(name) - # If attribute isn't already present we might be lazy loading it... + # If an attribute we should have isn't present it means either... + # + # a. we still need to lazy load this + # b. we read the whole descriptor but it wasn't present, so needs the default - if self._lazy_loading and name in self.ATTRIBUTES: + if name in self.ATTRIBUTES and not hasattr(self, name): default, parsing_function = self.ATTRIBUTES[name] - try: - parsing_function(self, self._entries) - except (ValueError, KeyError): + if self._lazy_loading: try: - # despite having a validation failure check to see if we set something - return super(Descriptor, self).__getattribute__(name) - except AttributeError: - setattr(self, name, copy.copy(default)) + parsing_function(self, self._entries) + except (ValueError, KeyError): + try: + # despite having a validation failure check to see if we set something + return super(Descriptor, self).__getattribute__(name) + except AttributeError: + setattr(self, name, _copy(default)) + else: + setattr(self, name, _copy(default)) return super(Descriptor, self).__getattribute__(name) [View Less]

1 0

[stem/master] Drop unnecessary check in descriptor accessor
by atagar＠torproject.org 30 Jan '17

30 Jan '17

commit 50c2539d7cfdf7cb8b07c58791ef29fb91cd9045 Author: Damian Johnson <atagar(a)torproject.org> Date: Wed Jan 25 18:28:31 2017 -0800 Drop unnecessary check in descriptor accessor The following conditional already checks if the attribute we're after is among a certain set. No need for this check too. --- stem/descriptor/__init__.py | 6 ------ 1 file changed, 6 deletions(-) diff --git a/stem/descriptor/__init__.py b/stem/descriptor/__init__.py index 1262f6a..0d4e73e … [View More]

1 0

[stem/master] Add new GUARD_WAIT circuit status
by atagar＠torproject.org 30 Jan '17

30 Jan '17

commit 91b5b9ce404ca099089d12d8b66e6c67a423e1e9 Author: Damian Johnson <atagar(a)torproject.org> Date: Mon Jan 30 08:35:27 2017 -0800 Add new GUARD_WAIT circuit status Newly added circuit status... https://gitweb.torproject.org/torspec.git/commit/?id=6446210 --- docs/change_log.rst | 4 ++++ stem/__init__.py | 23 ++++++++++++++--------- 2 files changed, 18 insertions(+), 9 deletions(-) diff --git a/docs/change_log.rst b/docs/change_log.rst index 1111afd..… [View More]

1 0

[stem/master] Validation for params fails due to ordering
by atagar＠torproject.org 30 Jan '17

30 Jan '17

commit 40fd99d8f14261f8221734e837ea0db1028dd127 Author: Damian Johnson <atagar(a)torproject.org> Date: Fri Jan 27 19:17:15 2017 -0800 Validation for params fails due to ordering We check that a params attribute is only supplied in consensus methods that should have it. However, we checked it before the value might be set. I'm not sure why this only surfaced with recent changes but unit tests failed for this reason. --- stem/descriptor/__init__.py | … [View More]

1 0

[translation/tor-launcher-properties_completed] Update translations for tor-launcher-properties_completed
by translation＠torproject.org 30 Jan '17

30 Jan '17

commit d3fc100d6da7cf57e68a989aed97291e84f98ffc Author: Translation commit bot <translation(a)torproject.org> Date: Mon Jan 30 17:15:59 2017 +0000 Update translations for tor-launcher-properties_completed --- pt/torlauncher.properties | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/pt/torlauncher.properties b/pt/torlauncher.properties index 61b4aa9..4689953 100644 --- a/pt/torlauncher.properties +++ b/pt/torlauncher.properties @@ -1,8 +1,9 @@ -### … [View More]Copyright (c) 2014, The Tor Project, Inc. +### Copyright (c) 2016, The Tor Project, Inc. ### See LICENSE for licensing information. torlauncher.error_title=Executor Tor +torlauncher.tor_exited_during_startup=O Tor fechou-se durante o arranque. Isto pode ter acontecido devido a erro no seu ficheiro torrc, um erro no Tor ou outro programa no seu sistema, ou falha de hardware. Até que corrija o problema em causa reinicie o Tor, o Navegador Tor não irá iniciar. torlauncher.tor_exited=O Tor encerrou inesperadamente. Isto pode ter acontecido devido a erro dentro do Tor, outro programa no seu sistema ou falha de hardware. Até que reinicie o Tor, o Navegador Tor não irá poder aceder a quaisquer sítios da Web. Se o problema persistir, por favor, envie uma cópia do Registo de Eventos do seu Tor para a equipa de suporte. torlauncher.tor_exited2=Ao reiniciar o Tor não irá fechar os separadores do seu navegador. torlauncher.tor_controlconn_failed=Não foi possível ligar à porta de controlo do Tor. @@ -13,8 +14,8 @@ torlauncher.tor_bootstrap_failed_details=%1$S falhou (%2$S). torlauncher.unable_to_start_tor=Não é possível iniciar o Tor.\n\n %S torlauncher.tor_missing=O executável do Tor está em falta. -torlauncher.torrc_missing=O ficheiro torrc está em falta. -torlauncher.datadir_missing=A pasta dos dados do Tor não existe. +torlauncher.torrc_missing=O ficheiro torc não existe e não pode ser criado. +torlauncher.datadir_missing=O diretório de dados Tor não existe e não pode ser criado. torlauncher.password_hash_missing=Não foi possível obter a senha "hashed". torlauncher.failed_to_get_settings=Não é possível obter as configurações do Tor\n\n %S @@ -36,6 +37,7 @@ torlauncher.quit_win=Fechar torlauncher.done=Concluído torlauncher.forAssistance=Para assistência, contacte %S +torlauncher.forAssistance2=Para assistência, visite %S torlauncher.copiedNLogMessages=Cópia completa. Estão prontas %S mensagens do registo de eventos do Tor para serem coladas num editor de texto ou numa mensagem de correio eletrónico. [View Less]

1 0

[translation/tor-launcher-properties] Update translations for tor-launcher-properties
by translation＠torproject.org 30 Jan '17

30 Jan '17

commit b3c9eeb7e0279c2e3dec96bc820b9ed6338abea6 Author: Translation commit bot <translation(a)torproject.org> Date: Mon Jan 30 17:15:55 2017 +0000 Update translations for tor-launcher-properties --- pt/torlauncher.properties | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pt/torlauncher.properties b/pt/torlauncher.properties index a01fa61..4689953 100644 --- a/pt/torlauncher.properties +++ b/pt/torlauncher.properties @@ -3,7 +3,7 @@ torlauncher.error_title=… [View More]

1 0

[tor/master] Remove XXXXprop271 comments from test_entrynodes.c
by nickm＠torproject.org 30 Jan '17

30 Jan '17

commit ed4a3dfef20935e6f357c2881a2db6b2b4445566 Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Jan 30 10:43:53 2017 -0500 Remove XXXXprop271 comments from test_entrynodes.c These commments were complaints about how I didn't like some aspects of prop271. They have been superseded by ticket 20832. --- src/test/test_entrynodes.c | 4 ---- 1 file changed, 4 deletions(-) diff --git a/src/test/test_entrynodes.c b/src/test/test_entrynodes.c index bcb56e3..… [View More]

1 0

[tor/master] Remove a couple of stale comments from entrynodes.h
by nickm＠torproject.org 30 Jan '17

30 Jan '17

commit 7d0df8bad857e48252d28445dbdc9c087d2e8168 Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Jan 30 10:38:24 2017 -0500 Remove a couple of stale comments from entrynodes.h --- src/or/entrynodes.h | 4 ---- 1 file changed, 4 deletions(-) diff --git a/src/or/entrynodes.h b/src/or/entrynodes.h index bd501d0..d469df7 100644 --- a/src/or/entrynodes.h +++ b/src/or/entrynodes.h @@ -392,9 +392,6 @@ int num_bridges_usable(void); #define DFLT_MAX_SAMPLE_SIZE 60 /** * We … [View More]

1 0

[tor/master] entrynodes: Remove "split these functions" XXXXs
by nickm＠torproject.org 30 Jan '17

30 Jan '17

commit cccd3f1dae32075ffd4c53de7709fc83b7db43fb Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Jan 30 10:49:40 2017 -0500 entrynodes: Remove "split these functions" XXXXs They now have a ticket: #21349. --- src/or/entrynodes.c | 3 --- 1 file changed, 3 deletions(-) diff --git a/src/or/entrynodes.c b/src/or/entrynodes.c index 587dec6..c5fb92e 100644 --- a/src/or/entrynodes.c +++ b/src/or/entrynodes.c @@ -1157,7 +1157,6 @@ entry_guard_is_listed,(… [View More]

1 0

[webwml/master] Revise 'Help improve Tor hidden services' project idea
by atagar＠torproject.org 30 Jan '17

30 Jan '17

commit 48d39df3d959728f4c01e3798156d8ea05c23eac Author: Damian Johnson <atagar(a)torproject.org> Date: Mon Jan 30 08:53:14 2017 -0800 Revise 'Help improve Tor hidden services' project idea George confirmed the idea's still relevant. Applying requested revisions. --- getinvolved/en/volunteer.wml | 37 +++++++++++++++++++------------------ 1 file changed, 19 insertions(+), 18 deletions(-) diff --git a/getinvolved/en/volunteer.wml b/getinvolved/en/volunteer.wml index … [View More]

1 0