August 2020 - tor-commits - lists.torproject.org

[translation/communitytpo-contentspot] https://gitweb.torproject.org/translation.git/commit/?h=communitytpo-contentspot
by translation＠torproject.org 11 Aug '20

11 Aug '20

commit 461e40420438a99b469ae60bed76668e77d00624 Author: Translation commit bot <translation(a)torproject.org> Date: Tue Aug 11 09:45:13 2020 +0000 https://gitweb.torproject.org/translation.git/commit/?h=communitytpo-conten… --- contents+es.po | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/contents+es.po b/contents+es.po index b86b8bef00..f6d77d6301 100644 --- a/contents+es.po +++ b/contents+es.po @@ -7734,6 +7734,8 @@ msgid "" "We are not aware of any case that made it near a court, and we will do " "everything in our power to support you if it does." msgstr "" +"No somos concientes de ningún caso que haya llegado cerca de una corte, y " +"haremos todo lo que esté en nuestro poder para respaldarte si lo hace." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7742,6 +7744,10 @@ msgid "" " at [ExoneraTor](https://exonerator.torproject.org/). Point to that website " "in your reply to the complaint." msgstr "" +"Puedes buscar si una dirección IP estuvo listada como repetidor de salida en" +" una cierta fecha y hora con " +"[ExoneraTor](https://exonerator.torproject.org/). Apunta a ese sitio web en " +"tu respuesta a la queja." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7750,6 +7756,9 @@ msgid "" " this information: Contact us at tor-assistants(a)torproject.org if you need " "one." msgstr "" +"Si sientes que puede ser útil, podemos escribirte una carta firmada " +"confirmando esta información: Contáctabos a tor-assistants AT torproject DOT" +" org si necesitas una." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body)

1 0

[translation/communitytpo-contentspot] https://gitweb.torproject.org/translation.git/commit/?h=communitytpo-contentspot
by translation＠torproject.org 11 Aug '20

11 Aug '20

commit 6e38e31c4cb62ce1ae7bc1e0e6873cd0e28ff8a9 Author: Translation commit bot <translation(a)torproject.org> Date: Tue Aug 11 09:15:18 2020 +0000 https://gitweb.torproject.org/translation.git/commit/?h=communitytpo-conten… --- contents+es.po | 23 +++++++++++++++++++++-- 1 file changed, 21 insertions(+), 2 deletions(-) diff --git a/contents+es.po b/contents+es.po index 0b59b60317..b86b8bef00 100644 --- a/contents+es.po +++ b/contents+es.po @@ -7655,16 +7655,18 @@ msgid "" "Also, if they do get a report about your relay, they'll think of you as a " "helpful expert rather than a potential criminal." msgstr "" +"También, si reciben un reporte acerca de tu repetidor, pensarán sobre ti " +"como un experto útil, en vez de como un potencial criminal." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) msgid "## Handling abuse complaints" -msgstr "" +msgstr "## Manejando quejas por abuso" #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) msgid "### Answering complaints" -msgstr "" +msgstr "### Respondiendo a quejas" #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7672,6 +7674,7 @@ msgid "" "If you receive an abuse complaint, don't freak out! Here is some advice for " "you:" msgstr "" +"Si recibes una queja por abuso, ¡no te rayes! He aquí algún consejo para ti:" #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7679,6 +7682,8 @@ msgid "" "### Answer to abuse complaints in a professional manner within a reasonable " "time span." msgstr "" +"### Responde a quejas por abuso de una manera profesional dentro de un lapso" +" razonable de tiempo." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7691,6 +7696,13 @@ msgid "" "the input of a lawyer in many years of operation following the advice on " "this page." msgstr "" +"TorServers.net es un operador de salidas Tor bastante grande, y solamente " +"recibimos un número de quejas muy pequeño, especialmente comparado con la " +"cantidad de tráfico que empujamos. Cerca del 80% son reportes automatizados," +" y el resto usualmente es satisfecho con [nuestra respuesta por " +"defecto](https://www.torservers.net/wiki/abuse/templates). No hemos " +"necesitado el aporte de un abogado en muchos años de operación, siguiendo " +"los consejos en esta página." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7701,6 +7713,11 @@ msgid "" "](tor-abuse-templates) . It is exceptionally rare to encounter a scenario " "where none of these templates apply." msgstr "" +"En adición a las [plantillas en " +"Torservers.net](https://www.torservers.net/wiki/abuse/templates), puedes " +"encontrar muchas más para varios escenarios en las [Plantillas para Abuso de" +" Tor](tor-abuse-templates). Es excepcionalmente raro encontrar un escenario " +"donde ninguna de estas plantillas aplica." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7708,6 +7725,8 @@ msgid "" "### If you receive a threatening letter from a lawyer about abusive use or a" " DMCA complaint, also don't freak out." msgstr "" +"### SI recibes una carta amenazante de un abogado acerca de uso abusivo o un" +" queja de la DMCA, tampoco te rayes." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body)

1 0

[translation/communitytpo-contentspot] https://gitweb.torproject.org/translation.git/commit/?h=communitytpo-contentspot
by translation＠torproject.org 11 Aug '20

11 Aug '20

commit 7af7d34cce7cb5ca8355745776151d3985205f75 Author: Translation commit bot <translation(a)torproject.org> Date: Tue Aug 11 08:45:12 2020 +0000 https://gitweb.torproject.org/translation.git/commit/?h=communitytpo-conten… --- contents+es.po | 28 ++++++++++++++++++++++++++++ 1 file changed, 28 insertions(+) diff --git a/contents+es.po b/contents+es.po index 955b0c5dcc..0b59b60317 100644 --- a/contents+es.po +++ b/contents+es.po @@ -7577,11 +7577,18 @@ msgid "" "/eff-tor-legal-faq). EFF has also offered to talk to other lawyers to " "explain the legal aspects of Tor." msgstr "" +"Es mucho mejor para ellos escuchar acerca de Tor por tu parte, en un " +"ambiente relajado, que escuchar acerca de ello por parte de un extraño, por " +"teléfono. Haz que sean concientes de [Preguntas Legales Más Frecuentes para " +"Operadores de Tor](/relay/community-resources/eff-tor-legal-faq). La EFF " +"también ha ofrecido hablar con otrros abogados para explicarles los aspectos" +" legales de Tor." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) msgid "### If you're not part of an organization, think about starting one!" msgstr "" +"### Si no eres parte de una organización, ¡piensa acerca de iniciar una!" #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7596,12 +7603,24 @@ msgid "" "like structure is that it might still work even when you leave, if you " "manage to find successors." msgstr "" +"Dependiendo de la forma elegida, establecer un cuerpo legal puede ayudar con" +" la responsabilidad, y en general ayuda a aparecer más grande de lo que eres" +" (y menos probable de ser allanado). Los tipos de Torservers.net en Alemania" +" encontraron a un abogado que acordaría en \"alojarlos\" dentro de su " +"oficina. Ahora son una asociación sin fines de lucro (\"eingetragener " +"Verein, gemeinnutzig\") registrada dentro de la oficina del abogado. El " +"proceso de establecimiento fue fácil y barato. En forma similar, " +"probablemente existe para tu país. Otro beneficio de una estructura parecida" +" a una asociación es que aún puede funcionar incluso cuando te vayas, si " +"consigues encontrar sucesores." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) msgid "" "### Consider preemptively teaching your local law enforcement about Tor." msgstr "" +"### Considera enseñarle preventivamente a la fuerza de policía local acerca " +"de Tor." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7611,6 +7630,11 @@ msgid "" "police-stuttgart) -- they're typically overwhelmed by their jobs and don't " "have enough background to know where to start." msgstr "" +"A las personas en \"cibercrimen\" realmente les encanta cuando les ofreces " +"[enseñarles acerca de Tor y la Internet](https://blog.torproject.org/blog" +"/talking-german-police-stuttgart) -- típicamente, están sobrepasados por " +"sus trabajos y no tienen suficientes antecedentes para saber por dónde " +"empezar." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7620,6 +7644,10 @@ msgid "" "criminals](https://2019.www.torproject.org/docs/faq-" "abuse#WhatAboutCriminals)." msgstr "" +"Contactarlos te da una chance de enseñarles por qué Tor es útil para el " +"mundo (y por qué [no lo es particularmente para los " +"criminales](https://2019.www.torproject.org/docs/faq-" +"abuse#WhatAboutCriminals)." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body)

1 0

[translation/communitytpo-contentspot] https://gitweb.torproject.org/translation.git/commit/?h=communitytpo-contentspot
by translation＠torproject.org 11 Aug '20

11 Aug '20

commit d9693caae0f85c721da0b3028a2310d38e5ff6d7 Author: Translation commit bot <translation(a)torproject.org> Date: Tue Aug 11 08:15:11 2020 +0000 https://gitweb.torproject.org/translation.git/commit/?h=communitytpo-conten… --- contents+es.po | 15 +++++++++++++-- 1 file changed, 13 insertions(+), 2 deletions(-) diff --git a/contents+es.po b/contents+es.po index 4bcf756248..955b0c5dcc 100644 --- a/contents+es.po +++ b/contents+es.po @@ -7518,6 +7518,8 @@ msgid "" "* Germany: [TMG 8](http://www.gesetze-im-internet.de/tmg/__8.html) and " "[15](http://www.gesetze-im-internet.de/tmg/__15.html)." msgstr "" +"* Alemania: [TMG 8](http://www.gesetze-im-internet.de/tmg/__8.html) y " +"[15](http://www.gesetze-im-internet.de/tmg/__15.html)." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7525,6 +7527,8 @@ msgid "" "* Netherlands: [Artikel 6:196c " "BW](http://wetten.overheid.nl/BWBR0005289/Boek6/Titel3/Afdeling4A/Artikel196c/)" msgstr "" +"* Holanda: [Artikel 6:196c " +"BW](http://wetten.overheid.nl/BWBR0005289/Boek6/Titel3/Afdeling4A/Artikel196c/)" #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7532,16 +7536,18 @@ msgid "" "* Austria: [ECG " "13](http://www.ris.bka.gv.at/Dokument.wxe?Abfrage=Bundesnormen&Dokumentnummer=NOR40025809)" msgstr "" +"* Austria: [ECG " +"13](http://www.ris.bka.gv.at/Dokument.wxe?Abfrage=Bundesnormen&Dokumentnummer=NOR40025809)" #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) msgid "* France: FIXME" -msgstr "" +msgstr "* Francia: FIXME" #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) msgid "* Sweden: [16-19 2002:562](https://lagen.nu/2002:562#P16S1)" -msgstr "" +msgstr "* Suecia: [16-19 2002:562](https://lagen.nu/2002:562#P16S1)" #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7549,6 +7555,8 @@ msgid "" "If you country is missing here and you know a lawyer who can provide a legal" " opinion, please get in contact with Tor Project." msgstr "" +"Si tu país falta aquí y conoces un abogado que pueda proveer una opinión " +"legal, por favor ponte en contacto con el Tor Project." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body) @@ -7556,6 +7564,9 @@ msgid "" "### If you're part of an organization that will be running the exit relay " "(ISP, university etc), consider teaching your legal people about Tor." msgstr "" +"### Si eres parte de una organización que estará corriendo el repetidor de " +"salida (ISP, universidad, etc), considera enseñarle a las personas a cargo " +"de cuestiones legales acerca de Tor." #: https//community.torproject.org/relay/community-resources/tor-exit-guidelines/ #: (content/relay-operations/community-resources/tor-exit-guidelines/contents+en.lrpage.body)

1 0

[tor/maint-0.4.2] Try to set up a minimal gitlab CI script
by nickm＠torproject.org 10 Aug '20

10 Aug '20

commit 057f40f3d8e64389be40f26de6b634f2b8aab0d4 Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Aug 10 16:10:12 2020 -0400 Try to set up a minimal gitlab CI script This is based on @eighthave's templates, and the work we've been doing to present a uniform testing environment. --- .gitlab-ci.yml | 120 ++++++++++++++++++++++++++++++++++++++++++++++++++------- 1 file changed, 107 insertions(+), 13 deletions(-) diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index e8d6c5f418..fc160ffaea 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -1,17 +1,111 @@ -image: debian:stable +# This file controls how gitlab validates Tor commits and merge requests. +# +# It is primarily based on a set of scripts and configurations by +# Hans-Christoph Steiner. It only copies parts of those scripts and +# configurations for now. If you want a new piece of functionality +# (more debians, more fedoras, android support) then you shouldn't +# start from scratch: have a look at the original ticket, at +# https://gitlab.torproject.org/tpo/core/tor/-/issues/32193 ! +# +# The file to copy from is +# https://gitlab.torproject.org/tpo/core/tor/-/merge_requests/96/diffs#diff-c… +# +# Having said that, if there is anything really stupid here, don't +# blame it on Hans-Christoph! Tor probably added it on their own. +# +# Copyright 2020, The Tor Project, Inc. +# See LICENSE for licence information. -before_script: - - apt-get update -qq - - apt-get upgrade -qy +# These variables are set everywhere, unconditionally. +variables: + TERM: "ansi" + DEBUG_CI: "yes" -build: +# This template is for exporting ephemeral things from the scripts. By +# convention we expect our scripts to copy stuff into artifacts/, rather than +# having a big list of files that be treated as artifacts. +.artifacts-template: &artifacts-template + artifacts: + name: "${CI_PROJECT_PATH}_${CI_JOB_STAGE}_${CI_COMMIT_REF_NAME}_${CI_COMMIT_SHA}" + expire_in: 1 week + when: always + paths: + - artifacts/ + +.apt-template: &apt-template | + export LC_ALL=C.UTF-8 + echo Etc/UTC > /etc/timezone + mkdir -p apt-cache + export APT_CACHE_DIR="$(pwd)/apt-cache" + echo 'quiet "1";' \ + 'APT::Install-Recommends "0";' \ + 'APT::Install-Suggests "0";' \ + 'APT::Acquire::Retries "20";' \ + 'APT::Get::Assume-Yes "true";' \ + 'Dpkg::Use-Pty "0";' \ + "Dir::Cache::Archives \"${APT_CACHE_DIR}\"; " \ + >> /etc/apt/apt.conf.d/99gitlab + apt-get update -qq + apt-get upgrade -qy + +.debian-template: &debian-template + <<: *artifacts-template + variables: + DEBIAN_FRONTEND: "noninteractive" + cache: + key: apt + paths: + - apt-cache + before_script: + - *apt-template + - apt-get install + automake + build-essential + git + libevent-dev + liblzma-dev + libscrypt-dev + libseccomp-dev + libssl-dev + pkg-config + python3 + zlib1g-dev + - if [ "$ASCIIDOC" = yes ]; then apt-get install asciidoc xmlto; fi + - if [ "$DOXYGEN" = yes ]; then apt-get install doxygen; fi + +debian-minimal: + image: debian:stable + <<: *debian-template script: - - apt-get install -qy --fix-missing automake build-essential - libevent-dev libssl-dev zlib1g-dev - libseccomp-dev liblzma-dev libscrypt-dev - - ./autogen.sh - - ./configure --disable-asciidoc --enable-fatal-warnings - --disable-silent-rules - - make check || (e=$?; cat test-suite.log; exit $e) - - make install + - ./scripts/ci/ci-driver.sh + +############################################### +# Temporarily diabled. This one just takes too long to finish right now! +# Maybe we need to divide the call to ./src/test/test into a few segments, +# that all end in similar amount of time? +#debian-hardened: +# image: debian:testing +# <<: *debian-template +# variables: +# HARDENING: "yes" +# script: +# - ./scripts/ci/ci-driver.sh +debian-distcheck: + image: debian:stable + <<: *debian-template + variables: + DISTCHECK: "yes" + CHECK: "no" + script: + - ./scripts/ci/ci-driver.sh + +debian-docs: + image: debian:stable + <<: *debian-template + variables: + DOXYGEN: "no" + ASCIIDOC: "no" + CHECK: "no" + script: + - ./scripts/ci/ci-driver.sh

1 0

[tor/maint-0.3.5] small code tweaks to try to work around debian stable complaints
by nickm＠torproject.org 10 Aug '20

10 Aug '20

commit e873c7e893987f5ad90ef401e6f986c62b4fc42d Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Aug 10 17:36:21 2020 -0400 small code tweaks to try to work around debian stable complaints --- src/feature/rend/rendclient.c | 4 ++-- src/lib/net/address.c | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/src/feature/rend/rendclient.c b/src/feature/rend/rendclient.c index cde954da95..5c9dbea8e3 100644 --- a/src/feature/rend/rendclient.c +++ b/src/feature/rend/rendclient.c @@ -261,8 +261,8 @@ rend_client_send_introduction(origin_circuit_t *introcirc, > MAX_NICKNAME_LEN)) { goto perm_err; } - strncpy(tmp, rendcirc->build_state->chosen_exit->nickname, - (MAX_NICKNAME_LEN+1)); /* nul pads */ + strlcpy(tmp, rendcirc->build_state->chosen_exit->nickname, + sizeof(tmp)); memcpy(tmp+MAX_NICKNAME_LEN+1, rendcirc->rend_data->rend_cookie, REND_COOKIE_LEN); dh_offset = MAX_NICKNAME_LEN+1+REND_COOKIE_LEN; diff --git a/src/lib/net/address.c b/src/lib/net/address.c index 076ca3eb34..69004ddb0e 100644 --- a/src/lib/net/address.c +++ b/src/lib/net/address.c @@ -337,7 +337,7 @@ tor_addr_to_str(char *dest, const tor_addr_t *addr, size_t len, int decorate) break; case AF_INET6: /* Shortest addr [ :: ] + \0 */ - if (len < (3 + (decorate ? 2 : 0))) + if (len < (3 + (decorate ? 2u : 0u))) return NULL; if (decorate)

1 0

[tor/maint-0.4.2] Add a shareable continuous-integration script.
by nickm＠torproject.org 10 Aug '20

10 Aug '20

commit cb027b392f0f93d543cad1689e407b5fd71c2dec Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Aug 10 15:58:28 2020 -0400 Add a shareable continuous-integration script. Eventually this should be used by every one of our CI scripts. --- scripts/ci/ci-driver.sh | 424 ++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 424 insertions(+) diff --git a/scripts/ci/ci-driver.sh b/scripts/ci/ci-driver.sh new file mode 100755 index 0000000000..50728a137e --- /dev/null +++ b/scripts/ci/ci-driver.sh @@ -0,0 +1,424 @@ +#!/bin/bash + +# This script is used to build Tor for continuous integration. It should +# be kept the same for all supported Tor versions. +# +# It's subject to the regular Tor license; see LICENSE for copying +# information. + +set -o errexit +set -o nounset + +# Options for this script. +DEBUG_CI="${DEBUG_CI:-no}" +COLOR_CI="${COLOR_CI:-yes}" + +# Options for which CI system this is. +ON_GITLAB="${ON_GITLAB:-yes}" + +# Options for how to build Tor. All should be yes/no. +FATAL_WARNINGS="${FATAL_WARNINGS:-yes}" +HARDENING="${HARDENING:-no}" +COVERAGE="${COVERAGE:-no}" +RUST="${RUST:-no}" +DOXYGEN="${DOXYGEN:-no}" +ASCIIDOC="${ASCIIDOC:-no}" + +# Options for which tests to run. All should be yes/no. +CHECK="${CHECK:-yes}" +STEM="${STEM:-no}" +CHUTNEY="${CHUTNEY:-no}" +DISTCHECK="${DISTCHECK:-no}" + +# Options for where the Tor source is. +CI_SRCDIR="${CI_SRCDIR:-.}" + +# Options for where to build. +CI_BUILDDIR="${CI_BUILDDIR:-./build}" + +# How parallel should we run make? +MAKE_J_OPT="${MAKE_J_OPT:--j4}" +# Should we stop after make finds an error? +MAKE_K_OPT="${MAKE_K_OPT:--k}" + +# What make target should we use for chutney? +CHUTNEY_MAKE_TARGET="${CHUTNEY_MAKE_TARGET:-test-network}" + +# Where do we find our additional testing tools? +CHUTNEY_PATH="${CHUTNEY_PATH:-}" +STEM_PATH="${STEM_PATH:-}" + +############################################################################# +# Preliminary functions. + +# Terminal coloring/emphasis stuff. +if [[ "${COLOR_CI}" == "yes" ]]; then + T_RED=$(tput setaf 1 || true) + T_GREEN=$(tput setaf 2 || true) + T_DIM=$(tput dim || true) + T_BOLD=$(tput bold || true) + T_RESET=$(tput sgr0 || true) +else + T_RED= + T_GREEN= + T_DIM= + T_BOLD= + T_RESET= +fi + +function error() +{ + echo "${T_BOLD}${T_RED}ERROR:${T_RESET} $*" 1>&2 +} +function die() +{ + echo "${T_BOLD}${T_RED}FATAL ERROR:${T_RESET} $*" 1>&2 + exit 1 +} +function hooray() +{ + echo "${T_BOLD}${T_GREEN}$*${T_RESET}" +} + +if [[ "${DEBUG_CI}" == "yes" ]]; then + function debug() + { + echo "${T_DIM}(debug): $*${T_RESET}" + } +else + function debug() + { + : + } +fi + +function yes_or_no() +{ + local varname="$1" + local value="${!varname}" + debug "${varname} is ${value}" + if [[ "${value}" != 'yes' && "${value}" != 'no' ]]; then + die "${varname} must be 'yes' or 'no'. Got unexpected value ${value}". + fi +} + +function incompatible() +{ + local varname1="$1" + local varname2="$2" + local val1="${!varname1}" + local val2="${!varname2}" + if [[ "${val1}" = 'yes' && "${val2}" = 'yes' ]]; then + die "Cannot set both ${varname1} and ${varname2}: they are incompatible." + fi +} + +function runcmd() +{ + echo "${T_BOLD}\$ $*${T_RESET}" + if ! "$@" ; then + error "command '$*' has failed." + return 1 + fi +} + +function show_git_version() +{ + local tool="$1" + local dir="$2" + local version="?????" + if [[ -e "$dir/.git" ]] ; then + version=$(cd "$dir"; git rev-parse HEAD) + fi + echo "${T_BOLD}$tool:${T_RESET} $version" +} + +if [[ "${ON_GITLAB}" == "yes" ]]; then + function start_section() + { + local label="$1" + local stamp + stamp=$(date +%s) + printf "section_start:%s:%s\r\e[0K" "$stamp" "$label" + echo "${T_BOLD}${T_GREEN}========= $label${T_RESET}" + } + function end_section() + { + local label="$1" + local stamp + stamp=$(date +%s) + printf "section_end:%s:%s\r\e[0K" "$stamp" "$label" + } +else + function start_section() + { + true + } + function end_section() + { + true + } +fi + +if [[ "$*" == "" ]]; then + RUN_STAGE_CONFIGURE="yes" + RUN_STAGE_BUILD="yes" + RUN_STAGE_TEST="yes" +else + RUN_STAGE_CONFIGURE="no" + RUN_STAGE_BUILD="no" + RUN_STAGE_TEST="no" + + for stage in "$@"; do + case "$stage" in + configure) + RUN_STAGE_CONFIGURE="yes" + ;; + build) + RUN_STAGE_BUILD="yes" + ;; + test) + RUN_STAGE_TEST="yes" + ;; + *) + error "Unknown stage $stage" + ;; + esac + done +fi + +############################################################################# +# Validate inputs. + +debug Validating inputs +yes_or_no DEBUG_CI +yes_or_no COLOR_CI +yes_or_no ON_GITLAB +yes_or_no FATAL_WARNINGS +yes_or_no HARDENING +yes_or_no COVERAGE +yes_or_no RUST +yes_or_no DOXYGEN +yes_or_no ASCIIDOC + +yes_or_no CHECK +yes_or_no STEM +yes_or_no DISTCHECK + +incompatible DISTCHECK CHECK +incompatible DISTCHECK CHUTNEY +incompatible DISTCHECK STEM +incompatible DISTCHECK COVERAGE +incompatible DISTCHECK DOXYGEN + +if [[ "${CHUTNEY}" = yes && "${CHUTNEY_PATH}" = '' ]] ; then + die "CHUTNEY is set to 'yes', but CHUTNEY_PATH was not specified." +fi + +if [[ "${STEM}" = yes && "${STEM_PATH}" = '' ]] ; then + die "STEM is set to 'yes', but STEM_PATH was not specified." +fi + +############################################################################# +# Set up options for make and configure. + +make_options=() +if [[ "$MAKE_J_OPT" != "" ]]; then + make_options+=("$MAKE_J_OPT") +fi +if [[ "$MAKE_K_OPT" != "" ]]; then + make_options+=("$MAKE_K_OPT") +fi + +configure_options=() +if [[ "$FATAL_WARNINGS" == "yes" ]]; then + configure_options+=("--enable-fatal-warnings") +fi +if [[ "$HARDENING" == "yes" ]]; then + configure_options+=("--enable-fragile-hardening") +fi +if [[ "$COVERAGE" == "yes" ]]; then + configure_options+=("--enable-coverage") +fi +if [[ "$RUST" == "yes" ]]; then + configure_options+=("--enable-rust") +fi +if [[ "$ASCIIDOC" != "yes" ]]; then + configure_options+=("--disable-asciidoc") +fi + +############################################################################# +# Tell the user about our versions of different tools and packages. + +uname -a +python -V || echo "no 'python' binary." +python3 -V || echo "no 'pythone' binary." + +show_git_version Tor "${CI_SRCDIR}" +if [[ "${STEM}" = "yes" ]]; then + show_git_version Stem "${STEM_PATH}" +fi +if [[ "${CHUTNEY}" = "yes" ]]; then + show_git_version Chutney "${CHUTNEY_PATH}" +fi + +############################################################################# +# Make sure the directories are all there. + +# Make sure CI_SRCDIR exists and has a file we expect. +if [[ ! -d "$CI_SRCDIR" ]] ; then + die "CI_SRCDIR=${CI_SRCDIR} is not a directory" +fi +if [[ ! -f "$CI_SRCDIR/src/core/or/or.h" ]] ; then + die "CI_SRCDIR=${CI_SRCDIR} does not look like a Tor directory." +fi + +# Make CI_SRCDIR absolute. +CI_SRCDIR=$(cd "$CI_SRCDIR" && pwd) + +# Create an "artifacts" directory to copy artifacts into. +mkdir -p ./artifacts + +if [[ "$RUN_STAGE_CONFIGURE" = "yes" ]]; then + + start_section "Autogen" + runcmd cd "${CI_SRCDIR}" + runcmd ./autogen.sh + runcmd mkdir -p "${CI_BUILDDIR}" + runcmd cd "${CI_BUILDDIR}" + end_section "Autogen" + + # make the builddir absolute too. + CI_BUILDDIR=$(pwd) + + start_section "Configure" + if ! runcmd "${CI_SRCDIR}"/configure "${configure_options[@]}" ; then + error "Here is the end of config.log:" + runcmd tail config.log + die "Unable to continue" + fi + end_section "Configure" +else + debug "Skipping configure stage. Making sure that ${CI_BUILDDIR}/config.log exists." + if [[ ! -d "${CI_BUILDDIR}" ]]; then + die "Build directory ${CI_BUILDDIR} did not exist!"; + fi + if [[ ! -f "${CI_BUILDDIR}/config.log" ]]; then + die "Tor was not configured in ${CI_BUILDDIR}!"; + fi + + cp config.log "${CI_SRCDIR}"/artifacts + + runcmd cd "${CI_BUILDDIR}" + CI_BUILDDIR=$(pwd) +fi + +############################### +# Build Tor. + +if [[ "$RUN_STAGE_BUILD" = "yes" ]] ; then + if [[ "$DISTCHECK" = "no" ]]; then + start_section "Build" + runcmd make "${make_options[@]}" all + cp src/app/tor "${CI_SRCDIR}"/artifacts + end_section "Build" + else + export DISTCHECK_CONFIGURE_FLAGS="${configure_options[*]}" + # XXXX Set make options? + start_section Distcheck + if runcmd make "${make_options[@]}" distcheck ; then + hooray "Distcheck was successful. Nothing further will be done." + # We have to exit early here, since we can't do any other tests. + cp tor-*.tar.gz "${CI_SRCDIR}"/artifacts + exit 0 + else + error "Diagnostics:" + runcmd make show-distdir-testlog || true + runcmd make show-distdir-core || true + die "Unable to continue." + fi + end_section Distcheck + fi +fi +############################## +# Run tests. + +if [[ "$RUN_STAGE_TEST" == "no" ]]; then + echo "Skipping tests. Exiting now." + exit 0 +fi + +if [[ "$RUN_STAGE_BUILD" = "no" ]] ; then + debug "Skipped build stage. Making sure that ./src/app/tor exists." + if [[ ! -f "./src/app/tor" ]]; then + die "$(pwd)/src/app/tor does not exist" + fi +fi + +FAILED_TESTS="" + +if [[ "${DOXYGEN}" = 'yes' ]]; then + start_section Doxygen + if runcmd make doxygen; then + hooray "make doxygen has succeeded." + else + FAILED_TESTS="${FAILED_TESTS} doxygen" + fi + end_section Doxygen +fi + +if [[ "${CHECK}" = "yes" ]]; then + start_section "Check" + if runcmd make "${make_options[@]}" check; then + hooray "make check has succeeded." + else + error "Here are the contents of the test suite output:" + runcmd cat test_suite.log || true + FAILED_TESTS="${FAILED_TESTS} check" + fi + end_section "Check" +fi + +if [[ "${CHUTNEY}" = "yes" ]]; then + start_section "Chutney" + if runcmd make "${CHUTNEY_MAKE_TARGET}"; then + hooray "Chutney tests have succeeded" + else + error "Chutney says:" + runcmd "${CHUTNEY_PATH}"/tools/diagnostics.sh || true + # XXXX These next two should be part of a make target. + runcmd ls test_network_log || true + runcmd cat test_network_log || true + FAILED_TESTS="${FAILED_TESTS} chutney" + fi + end_section "Chutney" +fi + +if [[ "${STEM}" = "yes" ]]; then + start_section "Stem" + # XXXX This shold probably be part some test-stem make target. + if runcmd timelimit -p -t 520 -s USR1 -T 30 -S ABRT \ + python3 "${STEM_PATH}/run_tests.py" \ + --tor src/app/tor \ + --integ --test control.controller \ + --test control.base_controller \ + --test process \ + --log TRACE \ + --log-file stem.log ; then + hooray "Stem tests have succeeded" + else + error "Stem output:" + runcmd tail -1000 "${STEM_PATH}"/test/data/tor_log + runcmd grep -v "SocketClosed" stem.log | tail -1000 + FAILED_TESTS="${FAILED_TESTS} stem" + fi + end_section "Stem" +fi + +# TODO: Coverage + +if [[ "${FAILED_TESTS}" != "" ]]; then + die "Failed tests: ${FAILED_TESTS}" +fi + +hooray "Everything seems fine."

1 0

[tor/maint-0.4.3] Try to set up a minimal gitlab CI script
by nickm＠torproject.org 10 Aug '20

10 Aug '20

commit 057f40f3d8e64389be40f26de6b634f2b8aab0d4 Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Aug 10 16:10:12 2020 -0400 Try to set up a minimal gitlab CI script This is based on @eighthave's templates, and the work we've been doing to present a uniform testing environment. --- .gitlab-ci.yml | 120 ++++++++++++++++++++++++++++++++++++++++++++++++++------- 1 file changed, 107 insertions(+), 13 deletions(-) diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index e8d6c5f418..fc160ffaea 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -1,17 +1,111 @@ -image: debian:stable +# This file controls how gitlab validates Tor commits and merge requests. +# +# It is primarily based on a set of scripts and configurations by +# Hans-Christoph Steiner. It only copies parts of those scripts and +# configurations for now. If you want a new piece of functionality +# (more debians, more fedoras, android support) then you shouldn't +# start from scratch: have a look at the original ticket, at +# https://gitlab.torproject.org/tpo/core/tor/-/issues/32193 ! +# +# The file to copy from is +# https://gitlab.torproject.org/tpo/core/tor/-/merge_requests/96/diffs#diff-c… +# +# Having said that, if there is anything really stupid here, don't +# blame it on Hans-Christoph! Tor probably added it on their own. +# +# Copyright 2020, The Tor Project, Inc. +# See LICENSE for licence information. -before_script: - - apt-get update -qq - - apt-get upgrade -qy +# These variables are set everywhere, unconditionally. +variables: + TERM: "ansi" + DEBUG_CI: "yes" -build: +# This template is for exporting ephemeral things from the scripts. By +# convention we expect our scripts to copy stuff into artifacts/, rather than +# having a big list of files that be treated as artifacts. +.artifacts-template: &artifacts-template + artifacts: + name: "${CI_PROJECT_PATH}_${CI_JOB_STAGE}_${CI_COMMIT_REF_NAME}_${CI_COMMIT_SHA}" + expire_in: 1 week + when: always + paths: + - artifacts/ + +.apt-template: &apt-template | + export LC_ALL=C.UTF-8 + echo Etc/UTC > /etc/timezone + mkdir -p apt-cache + export APT_CACHE_DIR="$(pwd)/apt-cache" + echo 'quiet "1";' \ + 'APT::Install-Recommends "0";' \ + 'APT::Install-Suggests "0";' \ + 'APT::Acquire::Retries "20";' \ + 'APT::Get::Assume-Yes "true";' \ + 'Dpkg::Use-Pty "0";' \ + "Dir::Cache::Archives \"${APT_CACHE_DIR}\"; " \ + >> /etc/apt/apt.conf.d/99gitlab + apt-get update -qq + apt-get upgrade -qy + +.debian-template: &debian-template + <<: *artifacts-template + variables: + DEBIAN_FRONTEND: "noninteractive" + cache: + key: apt + paths: + - apt-cache + before_script: + - *apt-template + - apt-get install + automake + build-essential + git + libevent-dev + liblzma-dev + libscrypt-dev + libseccomp-dev + libssl-dev + pkg-config + python3 + zlib1g-dev + - if [ "$ASCIIDOC" = yes ]; then apt-get install asciidoc xmlto; fi + - if [ "$DOXYGEN" = yes ]; then apt-get install doxygen; fi + +debian-minimal: + image: debian:stable + <<: *debian-template script: - - apt-get install -qy --fix-missing automake build-essential - libevent-dev libssl-dev zlib1g-dev - libseccomp-dev liblzma-dev libscrypt-dev - - ./autogen.sh - - ./configure --disable-asciidoc --enable-fatal-warnings - --disable-silent-rules - - make check || (e=$?; cat test-suite.log; exit $e) - - make install + - ./scripts/ci/ci-driver.sh + +############################################### +# Temporarily diabled. This one just takes too long to finish right now! +# Maybe we need to divide the call to ./src/test/test into a few segments, +# that all end in similar amount of time? +#debian-hardened: +# image: debian:testing +# <<: *debian-template +# variables: +# HARDENING: "yes" +# script: +# - ./scripts/ci/ci-driver.sh +debian-distcheck: + image: debian:stable + <<: *debian-template + variables: + DISTCHECK: "yes" + CHECK: "no" + script: + - ./scripts/ci/ci-driver.sh + +debian-docs: + image: debian:stable + <<: *debian-template + variables: + DOXYGEN: "no" + ASCIIDOC: "no" + CHECK: "no" + script: + - ./scripts/ci/ci-driver.sh

1 0

[tor/maint-0.4.2] Merge branch 'maint-0.3.5' into maint-0.4.2
by nickm＠torproject.org 10 Aug '20

10 Aug '20

commit 68f8250cbb6f1844e7f16f5f1bc8063b8bbfdf14 Merge: 352991c843 e873c7e893 Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Aug 10 19:32:49 2020 -0400 Merge branch 'maint-0.3.5' into maint-0.4.2 .gitlab-ci.yml | 120 ++++++++++-- scripts/ci/ci-driver.sh | 424 ++++++++++++++++++++++++++++++++++++++++++ src/feature/rend/rendclient.c | 4 +- 3 files changed, 533 insertions(+), 15 deletions(-)

1 0

[tor/maint-0.4.3] Merge branch 'maint-0.3.5' into maint-0.4.2
by nickm＠torproject.org 10 Aug '20

10 Aug '20

commit 68f8250cbb6f1844e7f16f5f1bc8063b8bbfdf14 Merge: 352991c843 e873c7e893 Author: Nick Mathewson <nickm(a)torproject.org> Date: Mon Aug 10 19:32:49 2020 -0400 Merge branch 'maint-0.3.5' into maint-0.4.2 .gitlab-ci.yml | 120 ++++++++++-- scripts/ci/ci-driver.sh | 424 ++++++++++++++++++++++++++++++++++++++++++ src/feature/rend/rendclient.c | 4 +- 3 files changed, 533 insertions(+), 15 deletions(-)

1 0