January 2017 - tor-commits - lists.torproject.org

[bridgedb/develop] Update CHANGELOG for 0.4.0.
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit 62b17e87a199ed0163ef01708f2369389658960b Author: Isis Lovecruft <isis(a)torproject.org> Date: Mon Jan 9 19:58:00 2017 +0000 Update CHANGELOG for 0.4.0. --- CHANGELOG | 24 +++++++++++++++++------- 1 file changed, 17 insertions(+), 7 deletions(-) diff --git a/CHANGELOG b/CHANGELOG index c0eb021..57e67cf 100644 --- a/CHANGELOG +++ b/CHANGELOG @@ -1,13 +1,23 @@ +Changes in version 0.4.0 - 2017-01-09 + + * FIXES #21162 https://bugs.torproject.org/21162 + BridgeDB now supports arbitrarily blacklisting suspected bad + bridges from being distributed to clients. This is in response + to a suspected sybil attack by an unknown party. For more + details, see: + https://lists.torproject.org/pipermail/tor-project/2016-December/000851.html + + Changes in version 0.3.8 - 2016-09-22 - * FIXES #20088 https://bugs.torproject.org/20088 - BridgeDB now supports receiving descriptors from multiple Bridge - Authorities. See also #19690. + * FIXES #20088 https://bugs.torproject.org/20088 + BridgeDB now supports receiving descriptors from multiple Bridge + Authorities. See also #19690. - * FIXES #20087 https://bugs.torproject.org/20087 - BridgeDB's version of Stem now supports parsing transport lines in - bridge extrainfo descriptors which contain IPv6 addresses - contained within square brackets. + * FIXES #20087 https://bugs.torproject.org/20087 + BridgeDB's version of Stem now supports parsing transport lines in + bridge extrainfo descriptors which contain IPv6 addresses + contained within square brackets. Changes in version 0.3.7 - 2016-08-04

1 0

[bridgedb/develop] Merge branch 'master' into develop
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit ab51b841590e422d81fe6138929ec52c9fe1167c Merge: 62b17e8 a09089c Author: Isis Lovecruft <isis(a)torproject.org> Date: Mon Jan 9 19:59:05 2017 +0000 Merge branch 'master' into develop

1 0

[bridgedb/develop] Merge branch 'fix/21162' into develop
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit 8de9321305b3868317d518141f516cb85d7728da Merge: a333183 829f970 Author: Isis Lovecruft <isis(a)torproject.org> Date: Mon Jan 9 19:49:43 2017 +0000 Merge branch 'fix/21162' into develop bridgedb.conf | 10 +++++++ bridgedb/Main.py | 7 +++++ bridgedb/configure.py | 2 +- bridgedb/parse/blacklist.py | 67 +++++++++++++++++++++++++++++++++++++++++++++ 4 files changed, 85 insertions(+), 1 deletion(-)

1 0

[bridgedb/develop] Merge branch 'release/0.4.0'
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit a09089c58cc337a6ee90cc6ac889a2fcc950a2a0 Merge: 9f753b3 62b17e8 Author: Isis Lovecruft <isis(a)torproject.org> Date: Mon Jan 9 19:58:47 2017 +0000 Merge branch 'release/0.4.0' CHANGELOG | 24 +++++++++++----- bridgedb.conf | 10 +++++++ bridgedb/Main.py | 7 +++++ bridgedb/configure.py | 2 +- bridgedb/parse/blacklist.py | 67 +++++++++++++++++++++++++++++++++++++++++++++ 5 files changed, 102 insertions(+), 8 deletions(-)

1 0

[bridgedb/develop] Add support for blacklisting bad bridges.
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit 829f97037075ebb7022b01e8631d398a65919704 Author: Isis Lovecruft <isis(a)torproject.org> Date: Sat Jan 7 22:04:39 2017 +0000 Add support for blacklisting bad bridges. * FIXES #21162: https://bugs.torproject.org/21162 --- bridgedb.conf | 10 +++++++ bridgedb/Main.py | 7 +++++ bridgedb/configure.py | 2 +- bridgedb/parse/blacklist.py | 67 +++++++++++++++++++++++++++++++++++++++++++++ 4 files changed, 85 insertions(+), 1 deletion(-) diff --git a/bridgedb.conf b/bridgedb.conf index 2d73a2b..4c547f5 100644 --- a/bridgedb.conf +++ b/bridgedb.conf @@ -239,6 +239,16 @@ COLLECT_TIMESTAMPS = False # following countries: NO_DISTRIBUTION_COUNTRIES = ['IR', 'SY'] +# The path to a file containing the fingerprints of blacklisted bridges and +# their reason for being blacklisted. An entry should be in the form: +# +# FINGERPRINT [SP REASON] +# +# where REASON is optional and may contain whitespace. +# +# (See NO_DISTRIBUTION_FINGERPRINTS in the code for how this is used.) +NO_DISTRIBUTION_FILE = None + # A list of filenames that contain IP addresses (one per line) of proxies. # All IP-based distributors that see an incoming connection from a proxy # will treat them specially. diff --git a/bridgedb/Main.py b/bridgedb/Main.py index dc618cb..4990904 100644 --- a/bridgedb/Main.py +++ b/bridgedb/Main.py @@ -34,6 +34,7 @@ from bridgedb.configure import loadConfig from bridgedb.email.distributor import EmailDistributor from bridgedb.https.distributor import HTTPSDistributor from bridgedb.parse import descriptors +from bridgedb.parse.blacklist import parseBridgeBlacklistFile import bridgedb.Storage @@ -150,6 +151,8 @@ def load(state, hashring, clear=False): "but could not find bridge with that fingerprint.") % router.fingerprint) + blacklist = parseBridgeBlacklistFile(state.NO_DISTRIBUTION_FILE) + inserted = 0 logging.info("Inserting %d bridges into hashring..." % len(bridges)) for fingerprint, bridge in bridges.items(): @@ -159,6 +162,10 @@ def load(state, hashring, clear=False): if bridge.country in state.NO_DISTRIBUTION_COUNTRIES: logging.warn("Not distributing Bridge %s %s:%s in country %s!" % (bridge, bridge.address, bridge.orPort, bridge.country)) + # Skip insertion of blacklisted bridges. + elif bridge in blacklist.keys(): + logging.warn("Not distributing blacklisted Bridge %s %s:%s: %s" % + (bridge, bridge.address, bridge.orPort, blacklist[bridge])) else: # If the bridge is not running, then it is skipped during the # insertion process. diff --git a/bridgedb/configure.py b/bridgedb/configure.py index 6c13595..02eea65 100644 --- a/bridgedb/configure.py +++ b/bridgedb/configure.py @@ -113,7 +113,7 @@ def loadConfig(configFile=None, configCls=None): "LOG_FILE", "COUNTRY_BLOCK_FILE", "GIMP_CAPTCHA_DIR", "GIMP_CAPTCHA_HMAC_KEYFILE", "GIMP_CAPTCHA_RSA_KEYFILE", "EMAIL_GPG_HOMEDIR", - "EMAIL_GPG_PASSPHRASE_FILE"]: + "EMAIL_GPG_PASSPHRASE_FILE", "NO_DISTRIBUTION_FILE"]: setting = getattr(config, attr, None) if setting is None: setattr(config, attr, setting) diff --git a/bridgedb/parse/blacklist.py b/bridgedb/parse/blacklist.py new file mode 100644 index 0000000..092f3e1 --- /dev/null +++ b/bridgedb/parse/blacklist.py @@ -0,0 +1,67 @@ +# -*- coding: utf-8 ; test-case-name: bridgedb.test.test_parse_descriptors ; -*- +#_____________________________________________________________________________ +# +# This file is part of BridgeDB, a Tor bridge distribution system. +# +# :authors: Isis Lovecruft 0xA3ADB67A2CDB8B35 <isis(a)torproject.org> +# please also see AUTHORS file +# :copyright: (c) 2007-2017, The Tor Project, Inc. +# (c) 2014-2017, Isis Lovecruft +# :license: see LICENSE for licensing information +#_____________________________________________________________________________ + +"""Parsers for bridge blacklist files. + + +.. py:module:: bridgedb.parse.blacklist + :synopsis: Parsers for bridge blacklist files. + +bridgedb.parse.blacklist +=========================== +:: + + parseBridgeBlacklistFile - Parse a bridge blacklist file. +.. +""" + +from __future__ import print_function + +import logging + +from bridgedb.parse.fingerprint import isValidFingerprint + + +def parseBridgeBlacklistFile(filename): + """Parse a file of fingerprints of blacklisted bridges. + + This file should be specified in ``bridgedb.conf`` under the + ``NO_DISTRIBUTION_FILE`` setting, and each line in it should be + formatted in the following manner: + + FINGERPRINT [SP REASON] + + :type filename: str or None + :param filename: The path to or filename of the file containing + fingerprints of blacklisted bridges. + :returns: A dict whose keys are bridge fingerprints and values are + reasons for being blacklisted. + """ + fh = None + blacklist = {} + + if filename: + logging.info("Parsing bridge blacklist file: %s" % filename) + + try: + fh = open(filename) + except (OSError, IOError) as error: + logging.error("Error opening bridge blacklist file %s" % filename) + else: + for line in fh.readlines(): + fields = line.split(' ', 1) + fingerprint, reason = fields[0], fields[1] if len(fields)==2 else '' + + if isValidFingerprint(fingerprint): + blacklist[fingerprint] = reason + + return blacklist

1 0

[bridgedb/master] Add support for blacklisting bad bridges.
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit 829f97037075ebb7022b01e8631d398a65919704 Author: Isis Lovecruft <isis(a)torproject.org> Date: Sat Jan 7 22:04:39 2017 +0000 Add support for blacklisting bad bridges. * FIXES #21162: https://bugs.torproject.org/21162 --- bridgedb.conf | 10 +++++++ bridgedb/Main.py | 7 +++++ bridgedb/configure.py | 2 +- bridgedb/parse/blacklist.py | 67 +++++++++++++++++++++++++++++++++++++++++++++ 4 files changed, 85 insertions(+), 1 deletion(-) diff --git a/bridgedb.conf b/bridgedb.conf index 2d73a2b..4c547f5 100644 --- a/bridgedb.conf +++ b/bridgedb.conf @@ -239,6 +239,16 @@ COLLECT_TIMESTAMPS = False # following countries: NO_DISTRIBUTION_COUNTRIES = ['IR', 'SY'] +# The path to a file containing the fingerprints of blacklisted bridges and +# their reason for being blacklisted. An entry should be in the form: +# +# FINGERPRINT [SP REASON] +# +# where REASON is optional and may contain whitespace. +# +# (See NO_DISTRIBUTION_FINGERPRINTS in the code for how this is used.) +NO_DISTRIBUTION_FILE = None + # A list of filenames that contain IP addresses (one per line) of proxies. # All IP-based distributors that see an incoming connection from a proxy # will treat them specially. diff --git a/bridgedb/Main.py b/bridgedb/Main.py index dc618cb..4990904 100644 --- a/bridgedb/Main.py +++ b/bridgedb/Main.py @@ -34,6 +34,7 @@ from bridgedb.configure import loadConfig from bridgedb.email.distributor import EmailDistributor from bridgedb.https.distributor import HTTPSDistributor from bridgedb.parse import descriptors +from bridgedb.parse.blacklist import parseBridgeBlacklistFile import bridgedb.Storage @@ -150,6 +151,8 @@ def load(state, hashring, clear=False): "but could not find bridge with that fingerprint.") % router.fingerprint) + blacklist = parseBridgeBlacklistFile(state.NO_DISTRIBUTION_FILE) + inserted = 0 logging.info("Inserting %d bridges into hashring..." % len(bridges)) for fingerprint, bridge in bridges.items(): @@ -159,6 +162,10 @@ def load(state, hashring, clear=False): if bridge.country in state.NO_DISTRIBUTION_COUNTRIES: logging.warn("Not distributing Bridge %s %s:%s in country %s!" % (bridge, bridge.address, bridge.orPort, bridge.country)) + # Skip insertion of blacklisted bridges. + elif bridge in blacklist.keys(): + logging.warn("Not distributing blacklisted Bridge %s %s:%s: %s" % + (bridge, bridge.address, bridge.orPort, blacklist[bridge])) else: # If the bridge is not running, then it is skipped during the # insertion process. diff --git a/bridgedb/configure.py b/bridgedb/configure.py index 6c13595..02eea65 100644 --- a/bridgedb/configure.py +++ b/bridgedb/configure.py @@ -113,7 +113,7 @@ def loadConfig(configFile=None, configCls=None): "LOG_FILE", "COUNTRY_BLOCK_FILE", "GIMP_CAPTCHA_DIR", "GIMP_CAPTCHA_HMAC_KEYFILE", "GIMP_CAPTCHA_RSA_KEYFILE", "EMAIL_GPG_HOMEDIR", - "EMAIL_GPG_PASSPHRASE_FILE"]: + "EMAIL_GPG_PASSPHRASE_FILE", "NO_DISTRIBUTION_FILE"]: setting = getattr(config, attr, None) if setting is None: setattr(config, attr, setting) diff --git a/bridgedb/parse/blacklist.py b/bridgedb/parse/blacklist.py new file mode 100644 index 0000000..092f3e1 --- /dev/null +++ b/bridgedb/parse/blacklist.py @@ -0,0 +1,67 @@ +# -*- coding: utf-8 ; test-case-name: bridgedb.test.test_parse_descriptors ; -*- +#_____________________________________________________________________________ +# +# This file is part of BridgeDB, a Tor bridge distribution system. +# +# :authors: Isis Lovecruft 0xA3ADB67A2CDB8B35 <isis(a)torproject.org> +# please also see AUTHORS file +# :copyright: (c) 2007-2017, The Tor Project, Inc. +# (c) 2014-2017, Isis Lovecruft +# :license: see LICENSE for licensing information +#_____________________________________________________________________________ + +"""Parsers for bridge blacklist files. + + +.. py:module:: bridgedb.parse.blacklist + :synopsis: Parsers for bridge blacklist files. + +bridgedb.parse.blacklist +=========================== +:: + + parseBridgeBlacklistFile - Parse a bridge blacklist file. +.. +""" + +from __future__ import print_function + +import logging + +from bridgedb.parse.fingerprint import isValidFingerprint + + +def parseBridgeBlacklistFile(filename): + """Parse a file of fingerprints of blacklisted bridges. + + This file should be specified in ``bridgedb.conf`` under the + ``NO_DISTRIBUTION_FILE`` setting, and each line in it should be + formatted in the following manner: + + FINGERPRINT [SP REASON] + + :type filename: str or None + :param filename: The path to or filename of the file containing + fingerprints of blacklisted bridges. + :returns: A dict whose keys are bridge fingerprints and values are + reasons for being blacklisted. + """ + fh = None + blacklist = {} + + if filename: + logging.info("Parsing bridge blacklist file: %s" % filename) + + try: + fh = open(filename) + except (OSError, IOError) as error: + logging.error("Error opening bridge blacklist file %s" % filename) + else: + for line in fh.readlines(): + fields = line.split(' ', 1) + fingerprint, reason = fields[0], fields[1] if len(fields)==2 else '' + + if isValidFingerprint(fingerprint): + blacklist[fingerprint] = reason + + return blacklist

1 0

[bridgedb/master] Merge branch 'fix/21162' into develop
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit 8de9321305b3868317d518141f516cb85d7728da Merge: a333183 829f970 Author: Isis Lovecruft <isis(a)torproject.org> Date: Mon Jan 9 19:49:43 2017 +0000 Merge branch 'fix/21162' into develop bridgedb.conf | 10 +++++++ bridgedb/Main.py | 7 +++++ bridgedb/configure.py | 2 +- bridgedb/parse/blacklist.py | 67 +++++++++++++++++++++++++++++++++++++++++++++ 4 files changed, 85 insertions(+), 1 deletion(-)

1 0

[bridgedb/master] Merge branch 'master' into develop
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit a333183218e4239f2d7bebeb7a3a988bc4990a6c Merge: 78e352e 9f753b3 Author: Isis Lovecruft <isis(a)torproject.org> Date: Thu Sep 22 12:08:16 2016 +0000 Merge branch 'master' into develop

1 0

[bridgedb/master] Merge branch 'release/0.4.0'
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit a09089c58cc337a6ee90cc6ac889a2fcc950a2a0 Merge: 9f753b3 62b17e8 Author: Isis Lovecruft <isis(a)torproject.org> Date: Mon Jan 9 19:58:47 2017 +0000 Merge branch 'release/0.4.0' CHANGELOG | 24 +++++++++++----- bridgedb.conf | 10 +++++++ bridgedb/Main.py | 7 +++++ bridgedb/configure.py | 2 +- bridgedb/parse/blacklist.py | 67 +++++++++++++++++++++++++++++++++++++++++++++ 5 files changed, 102 insertions(+), 8 deletions(-)

1 0

[bridgedb/master] Update CHANGELOG for 0.4.0.
by isis＠torproject.org 09 Jan '17

09 Jan '17

commit 62b17e87a199ed0163ef01708f2369389658960b Author: Isis Lovecruft <isis(a)torproject.org> Date: Mon Jan 9 19:58:00 2017 +0000 Update CHANGELOG for 0.4.0. --- CHANGELOG | 24 +++++++++++++++++------- 1 file changed, 17 insertions(+), 7 deletions(-) diff --git a/CHANGELOG b/CHANGELOG index c0eb021..57e67cf 100644 --- a/CHANGELOG +++ b/CHANGELOG @@ -1,13 +1,23 @@ +Changes in version 0.4.0 - 2017-01-09 + + * FIXES #21162 https://bugs.torproject.org/21162 + BridgeDB now supports arbitrarily blacklisting suspected bad + bridges from being distributed to clients. This is in response + to a suspected sybil attack by an unknown party. For more + details, see: + https://lists.torproject.org/pipermail/tor-project/2016-December/000851.html + + Changes in version 0.3.8 - 2016-09-22 - * FIXES #20088 https://bugs.torproject.org/20088 - BridgeDB now supports receiving descriptors from multiple Bridge - Authorities. See also #19690. + * FIXES #20088 https://bugs.torproject.org/20088 + BridgeDB now supports receiving descriptors from multiple Bridge + Authorities. See also #19690. - * FIXES #20087 https://bugs.torproject.org/20087 - BridgeDB's version of Stem now supports parsing transport lines in - bridge extrainfo descriptors which contain IPv6 addresses - contained within square brackets. + * FIXES #20087 https://bugs.torproject.org/20087 + BridgeDB's version of Stem now supports parsing transport lines in + bridge extrainfo descriptors which contain IPv6 addresses + contained within square brackets. Changes in version 0.3.7 - 2016-08-04

1 0