isis transcribed 3.6K bytes:
Virgil Griffith transcribed 2.7K bytes:
Here's the line about unacceptability of crawling .onion:
"For example, it is not acceptable to run an HSDir, harvest onion addresses, and do a Web crawl of those onion services."
https://trac.torproject.org/projects/tor/wiki/org/meetings/2015SummerDevMeet...
So, this can indeed be an official policy. But it was the first I had heard of it. And currently at least 3-4 tor2web nodes in good-standing explicitly permit crawling of .onion .
Tor2web similarly should be killed with fire as being a blatant and disgusting workaround to the trust and expectations which onion service operators place in the network.
Simply because a user, given an onion service address, naïvely decides to use one of your Tor2Web nodes, it is unacceptable that your Tor2Web node crawls said onion service simply because it didn't "opt out" of your historically malicious desires to harvest data on Tor users and operators. Consent is not the absence of saying "no" — it is explicitly saying "yes".