tor-commits November 2017

tor-commits@lists.torproject.org

16 participants
2019 discussions

[tor/master] Merge branch 'maint-0.3.2'
by nickm＠torproject.org 02 Nov '17

02 Nov '17

commit cceb43c5e31e88535f39aa4b284c1e83ef69faa0 Merge: 65d22dc2f 038628048 Author: Nick Mathewson <nickm(a)torproject.org> Date: Thu Nov 2 10:34:08 2017 -0400 Merge branch 'maint-0.3.2' changes/bug24025 | 5 +++++ src/or/nodelist.c | 5 ++++- 2 files changed, 9 insertions(+), 1 deletion(-)

1 0

[tor/maint-0.3.2] nodelist: Downgrade warning to protocol warning
by nickm＠torproject.org 02 Nov '17

02 Nov '17

commit 0386280487fce78b73e060234f515b850af9c589 Author: David Goulet <dgoulet(a)torproject.org> Date: Wed Nov 1 12:15:15 2017 -0400 nodelist: Downgrade warning to protocol warning The node_get_ed25519_id() warning can actually be triggered by a relay flagged with NoEdConsensus so instead of triggering a warning on all relays of the network, downgrade it to protocol warning. Fixes #24025 Signed-off-by: David Goulet <dgoulet(a)torproject.org> -… [View More]

1 0

[tor/master] nodelist: Downgrade warning to protocol warning
by nickm＠torproject.org 02 Nov '17

02 Nov '17

1 0

[tor/master] sched: Use SCHED_BUG() macro in scheduler
by nickm＠torproject.org 02 Nov '17

02 Nov '17

commit 3931a6f264355d7fe017219f76bd5bec1d8bcbd8 Author: David Goulet <dgoulet(a)torproject.org> Date: Tue Oct 3 14:38:30 2017 -0400 sched: Use SCHED_BUG() macro in scheduler When a BUG() occurs, this macro will print extra information about the state of the scheduler and the given channel if any. This will help us greatly to fix future bugs in the scheduler especially when they occur rarely. Fixes #23753 Signed-off-by: David Goulet <dgoulet(a)… [View More]torproject.org> --- changes/bug23753 | 4 ++++ src/or/scheduler.c | 2 +- src/or/scheduler_kist.c | 8 ++++---- 3 files changed, 9 insertions(+), 5 deletions(-) diff --git a/changes/bug23753 b/changes/bug23753 new file mode 100644 index 000000000..8782a8e2d --- /dev/null +++ b/changes/bug23753 @@ -0,0 +1,4 @@ + o Minor features (logging, scheduler): + - Introduce a SCHED_BUG() function to log extra information about the + scheduler state if we ever catch a bug in the scheduler. Closes ticket + 23753. diff --git a/src/or/scheduler.c b/src/or/scheduler.c index c656c80e9..67911ff81 100644 --- a/src/or/scheduler.c +++ b/src/or/scheduler.c @@ -607,7 +607,7 @@ scheduler_release_channel,(channel_t *chan)) } if (chan->scheduler_state == SCHED_CHAN_PENDING) { - if (smartlist_pos(channels_pending, chan) == -1) { + if (SCHED_BUG(smartlist_pos(channels_pending, chan) == -1, chan)) { log_warn(LD_SCHED, "Scheduler asked to release channel %" PRIu64 " " "but it wasn't in channels_pending", chan->global_identifier); diff --git a/src/or/scheduler_kist.c b/src/or/scheduler_kist.c index d269fb49b..ea6910c70 100644 --- a/src/or/scheduler_kist.c +++ b/src/or/scheduler_kist.c @@ -116,7 +116,7 @@ channel_outbuf_length(channel_t *chan) /* In theory, this can not happen because we can not scheduler a channel * without a connection that has its outbuf initialized. Just in case, bug * on this so we can understand a bit more why it happened. */ - if (BUG(BASE_CHAN_TO_TLS(chan)->conn == NULL)) { + if (SCHED_BUG(BASE_CHAN_TO_TLS(chan)->conn == NULL, chan)) { return 0; } return buf_datalen(TO_CONN(BASE_CHAN_TO_TLS(chan)->conn)->outbuf); @@ -370,7 +370,7 @@ socket_can_write(socket_table_t *table, const channel_t *chan) { socket_table_ent_t *ent = NULL; ent = socket_table_search(table, chan); - IF_BUG_ONCE(!ent) { + if (SCHED_BUG(!ent, chan)) { return 1; // Just return true, saying that kist wouldn't limit the socket } @@ -390,7 +390,7 @@ update_socket_info(socket_table_t *table, const channel_t *chan) { socket_table_ent_t *ent = NULL; ent = socket_table_search(table, chan); - IF_BUG_ONCE(!ent) { + if (SCHED_BUG(!ent, chan)) { return; // Whelp. Entry didn't exist for some reason so nothing to do. } update_socket_info_impl(ent); @@ -402,7 +402,7 @@ update_socket_written(socket_table_t *table, channel_t *chan, size_t bytes) { socket_table_ent_t *ent = NULL; ent = socket_table_search(table, chan); - IF_BUG_ONCE(!ent) { + if (SCHED_BUG(!ent, chan)) { return; // Whelp. Entry didn't exist so nothing to do. } [View Less]

1 0

[tor/master] sched: Implement SCHED_BUG()
by nickm＠torproject.org 02 Nov '17

02 Nov '17

commit 2e8de0de3b5ae10277cd0fd72e782d2f6aa30c81 Author: David Goulet <dgoulet(a)torproject.org> Date: Tue Oct 3 13:58:22 2017 -0400 sched: Implement SCHED_BUG() Signed-off-by: David Goulet <dgoulet(a)torproject.org> --- src/or/scheduler.c | 29 +++++++++++++++++++++++++++++ src/or/scheduler.h | 8 ++++++++ 2 files changed, 37 insertions(+) diff --git a/src/or/scheduler.c b/src/or/scheduler.c index 22a9b574a..c656c80e9 100644 --- a/src/or/scheduler.c +++ b/src/or/… [View More]scheduler.c @@ -9,6 +9,9 @@ #define SCHEDULER_KIST_PRIVATE #include "scheduler.h" #include "main.h" +#include "buffers.h" +#define TOR_CHANNEL_INTERNAL_ +#include "channeltls.h" #include <event2/event.h> @@ -667,6 +670,32 @@ scheduler_channel_wants_writes(channel_t *chan) } } +/* Log warn the given channel and extra scheduler context as well. This is + * used by SCHED_BUG() in order to be able to extract as much information as + * we can when we hit a bug. Channel chan can be NULL. */ +void +scheduler_bug_occurred(const channel_t *chan) +{ + char buf[128]; + + if (chan != NULL) { + const size_t outbuf_len = + buf_datalen(TO_CONN(BASE_CHAN_TO_TLS((channel_t *) chan)->conn)->outbuf); + tor_snprintf(buf, sizeof(buf), + "Channel %" PRIu64 " in state %s and scheduler state %d." + " Num cells on cmux: %d. Connection outbuf len: %lu.", + chan->global_identifier, + channel_state_to_string(chan->state), + chan->scheduler_state, circuitmux_num_cells(chan->cmux), + outbuf_len); + } + + log_warn(LD_BUG, "%s Num pending channels: %d. Channel in pending list: %s", + (chan != NULL) ? buf : "No channel in bug context.", + smartlist_len(channels_pending), + (smartlist_pos(channels_pending, chan) == -1) ? "no" : "yes"); +} + #ifdef TOR_UNIT_TESTS /* diff --git a/src/or/scheduler.h b/src/or/scheduler.h index 0ec24db93..47c98f096 100644 --- a/src/or/scheduler.h +++ b/src/or/scheduler.h @@ -143,6 +143,14 @@ MOCK_DECL(void, scheduler_channel_has_waiting_cells, (channel_t *chan)); /********************************* * Defined in scheduler.c *********************************/ + +/* Triggers a BUG() and extra information with chan if available. */ +#define SCHED_BUG(cond, chan) \ + (PREDICT_UNLIKELY(cond) ? \ + ((BUG(cond)) ? (scheduler_bug_occurred(chan), 1) : 0) : 0) + +void scheduler_bug_occurred(const channel_t *chan); + smartlist_t *get_channels_pending(void); MOCK_DECL(int, scheduler_compare_channels, (const void *c1_v, const void *c2_v)); [View Less]

1 0

[tor/master] sched: Add another SCHED_BUG() callsite
by nickm＠torproject.org 02 Nov '17

02 Nov '17

commit 52050bb2c6b498c05c7ec54947deff5f662db34e Author: Matt Traudt <sirmatt(a)ksu.edu> Date: Tue Oct 3 16:48:35 2017 -0400 sched: Add another SCHED_BUG() callsite --- src/or/scheduler_kist.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/or/scheduler_kist.c b/src/or/scheduler_kist.c index ea6910c70..1bc92f249 100644 --- a/src/or/scheduler_kist.c +++ b/src/or/scheduler_kist.c @@ -572,7 +572,7 @@ kist_scheduler_run(void) /* get best channel */ … [View More]

1 0

[tor/release-0.3.2] sched: Rate limit scheduler_bug_occurred()
by nickm＠torproject.org 02 Nov '17

02 Nov '17

commit 6dc591a024e4dde8f4beafc7d42bdaeac996cca4 Author: David Goulet <dgoulet(a)torproject.org> Date: Thu Oct 26 14:44:44 2017 -0400 sched: Rate limit scheduler_bug_occurred() Just in case we end up hitting a SCHED_BUG() multiple times, rate limit the log warning. Signed-off-by: David Goulet <dgoulet(a)torproject.org> --- src/or/scheduler.c | 19 +++++++++++++++---- 1 file changed, 15 insertions(+), 4 deletions(-) diff --git a/src/or/scheduler.c b/src/… [View More]

1 0

[tor/release-0.3.2] Merge branch 'dgoulet_ticket23753_032_02_squashed' into maint-0.3.2
by nickm＠torproject.org 02 Nov '17

02 Nov '17

commit cb42c62c9e87d4699add69087ba25d1454758bb0 Merge: 27ea6fcd3 6dc591a02 Author: Nick Mathewson <nickm(a)torproject.org> Date: Thu Nov 2 10:30:42 2017 -0400 Merge branch 'dgoulet_ticket23753_032_02_squashed' into maint-0.3.2 changes/bug23753 | 4 ++++ src/or/scheduler.c | 42 +++++++++++++++++++++++++++++++++++++++++- src/or/scheduler.h | 8 ++++++++ src/or/scheduler_kist.c | 10 +++++----- 4 files changed, 58 insertions(+), 6 deletions(-)

1 0

[tor/release-0.3.2] Merge branch 'maint-0.3.2' into release-0.3.2
by nickm＠torproject.org 02 Nov '17

02 Nov '17

commit 668809192873f546767b8a431b7cfdf59c1abc1a Merge: 33652fce6 cb42c62c9 Author: Nick Mathewson <nickm(a)torproject.org> Date: Thu Nov 2 10:32:18 2017 -0400 Merge branch 'maint-0.3.2' into release-0.3.2 changes/bug23753 | 4 ++++ src/or/scheduler.c | 42 +++++++++++++++++++++++++++++++++++++++++- src/or/scheduler.h | 8 ++++++++ src/or/scheduler_kist.c | 10 +++++----- 4 files changed, 58 insertions(+), 6 deletions(-)

1 0

[tor/master] sched: Rate limit scheduler_bug_occurred()
by nickm＠torproject.org 02 Nov '17

02 Nov '17

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

tor-commits November 2017