MaxAdvertisedBandwidth, MaxOnionQueue and so on
Hi, currently trying to set up a bog standard relay node that's supposed to generate about 20TB/month of outgoing traffic. I've thus set RelayBandwidthRate 7500 KB RelayBandwidthBurst 20000 KB but keep getting tons of these Your computer is too slow to handle this many circuit creation requests! Please consider using the MaxAdvertisedBandwidth config option or choosing a more restricted exit policy. Questions: - Is this log message still accurate? I've seen from e.g. ticket 9005 that apparently circuit creation is anyway already handled in parallel, and my machine is definitely not constantly overloaded on all 8 threads. - The node also crashes far too often, i.e. multiple times a week. Annoyingly, I can't seem to get core dumps for these crashes even though I've verified that the core ulimit is set to unlimited, but still the crashes themselves or a kill -SEGV $TORPID do not give me core files. Any ideas? I've also verified that the cwd is /var/lib/tor and that /var/lib/tor is writable :( - I've also set MaxOnionQueue 250, but that didn't change much. Any other suggestions? ciao, -- [*Thomas Themel*] I just want an EDitor!! Not a "viitor". Not a "emacsitor". [Albulastrasse 52] Those aren't even WORDS!!!! ED! ED! ED IS THE STANDARD!!! [ CH-8048 Zürich ] [*+41 78 9070988*] Paul J. LoPresti in <1991Jul11.031731.9260@athena.mit.edu>
Hi Thomas, Thank you for running a relay! On 09/04/2013 01:00 PM, Thomas Themel wrote:
Your computer is too slow to handle this many circuit creation requests! Please consider using the MaxAdvertisedBandwidth config option or choosing a more restricted exit policy.
Right now, Tor sees a lot of circuit creation requests due to what most people think is a botnet that is using Tor. The second issue is that Tor does not scale well across multiple CPU cores yet. Looks like, either way, you are hitting the limit of your CPU core.
- I've also set MaxOnionQueue 250, but that didn't change much. Any other suggestions?
MaxOnionQueue should not be necessary or helpful to set in modern Tor releases. If you see a maxed out CPU core, what you might want to try is run multiple Tor processes in parallel. We do that, although usually for modern CPUs this is only necessary at and above roughly 100 Mbit/s. https://www.torservers.net/wiki/setup/server#multiple_tor_processes -- Moritz Bartl https://www.torservers.net/
Hi Moritz, Excerpts from Moritz Bartl's message of Wed Sep 04 13:17:04 +0200 2013:
If you see a maxed out CPU core, what you might want to try is run multiple Tor processes in parallel. We do that, although usually for modern CPUs this is only necessary at and above roughly 100 Mbit/s.
https://www.torservers.net/wiki/setup/server#multiple_tor_processes
Thanks, I'll try setting this up to make better use of the hardware. I assume the crashes will also go away once we're operating in a more normal load regime, though of course I'd prefer to find the root cause there. ciao, -- [*Thomas Themel*] Great Goddess Discordia, Holy Mother Eris, [Albulastrasse 52] Joy of the Universe, Laughter of Space, Grant [ CH-8048 Zürich ] us Life, Light, Love and Liberty and make the [*+41 78 9070988*] bloody magick work!
On Wed, 04 Sep 2013 13:00:02 +0200 Thomas Themel <thomas@themel.com> wrote:
- The node also crashes far too often, i.e. multiple times a week. Annoyingly, I can't seem to get core dumps for these crashes even though I've verified that the core ulimit is set to unlimited, but still the crashes themselves or a kill -SEGV $TORPID do not give me core files. Any ideas? I've also verified that the cwd is /var/lib/tor and that /var/lib/tor is writable :(
How much RAM do you have available there? Do you have any swap space? -- With respect, Roman
Hi Roman, Excerpts from Roman Mamedov's message of Wed Sep 04 13:25:59 +0200 2013:
On Wed, 04 Sep 2013 13:00:02 +0200 Thomas Themel <thomas@themel.com> wrote:
- The node also crashes far too often, i.e. multiple times a week. Annoyingly, I can't seem to get core dumps for these crashes even though I've verified that the core ulimit is set to unlimited, but still the crashes themselves or a kill -SEGV $TORPID do not give me core files. Any ideas? I've also verified that the cwd is /var/lib/tor and that /var/lib/tor is writable :(
How much RAM do you have available there? Do you have any swap space?
The machine is quite embarrasingly overpowered... root@wannabe2:~# df -h /var/lib/tor Filesystem Size Used Avail Use% Mounted on /dev/disk/by-uuid/92969840-6b8a-4d50-ba03-d0600725f9fa 1.8T 1017M 1.7T 1% / root@wannabe2:~# free total used free shared buffers cached Mem: 32878744 1204908 31673836 0 76172 450304 -/+ buffers/cache: 678432 32200312 Swap: 16776116 0 16776116 ciao, -- [*Thomas Themel*] And let's not forget USNS Bob Hope. I bet that name inspires [Albulastrasse 52] the crew as much as the old Flower Class Corvettes did. [ CH-8048 Zürich ] [*+41 78 9070988*] - Paul Tomblin in the monastery
participants (4)
-
Moritz Bartl -
Roman Mamedov -
thomas -
Thomas Themel