[metrics-team] Collector 1.1 Instance
karsten at torproject.org
Wed Nov 2 08:28:08 UTC 2016
-----BEGIN PGP SIGNED MESSAGE-----
On 01/11/16 20:37, Tom Ritter wrote:
> I've had it running for a few days here: https://bwauth.ritter.vg/
Neat! Are you planning to keep it running in the longer term? If so,
I'd want to enable synchronization from your CollecTor instance for
including descriptors that the primary CollecTor instance is missing.
I'm already synchronizing from iwakeh's CollecTor instance since
yesterday, and I think that having a third instance run by a trusted
person would be great.
Would it be difficult for you to create a new subdomain like
https://collector.ritter.vg/? I could imagine that we'll soon put
links to mirrors on the CollecTor page, and people might be confused
by the bwauth part.
> Historical data may be spotty but I didn't delete it. My config is
Looks good, except for one setting: `BridgeSources = Local` won't do
anything, because you don't have Bifroest's bridge descriptor
tarballs. You could either disable the module by setting
`BridgedescsActivated = false`, or you could synchronize sanitized
bridge descriptors from the primary CollecTor instance.
> One thing I noticed is that create-tarballs takes a LONG time. I
> mean I know it's supposed to, but I'm talking 14 hours. (I think
> the extra-info files seem to be the big ones).
True. It's taking 27.5 hours on the primary CollecTor instance:
Tue Nov 1 03:25:01 UTC 2016 Starting
Wed Nov 2 07:00:27 UTC 2016 Finished.
That's why that script is only running every 3 days.
And yes, the problem is to tar up the many small files. Ideally, we'd
like to create these tarballs in Java and also compress them there.
But we haven't had the time yet to look into that.
Thanks for setting up and running a CollecTor instance!
All the best,
> RunOnce = False ShutdownGraceWaitMinutes = 10 BridgedescsActivated
> = true BridgedescsPeriodMinutes = 60 BridgedescsOffsetMinutes = 9
> ExitlistsActivated = true ExitlistsPeriodMinutes = 60
> ExitlistsOffsetMinutes = 2 RelaydescsActivated = true
> RelaydescsPeriodMinutes = 30 RelaydescsOffsetMinutes = 5
> TorperfActivated = true TorperfPeriodMinutes = 360
> TorperfOffsetMinutes = 1 UpdateindexActivated = true
> UpdateindexPeriodMinutes = 2 UpdateindexOffsetMinutes = 0
> InstanceBaseUrl = https://bwauth.ritter.vg/collector/ IndexPath =
> index ArchivePath = archive RecentPath = recent OutputPath = out
> StatsPath = stats SyncPath = sync RelaySources = Remote
> RelaySyncOrigins = https://collector.torproject.org
> RelayCacheOrigins = in/relay-descriptors/cacheddesc/
> RelayLocalOrigins = in/relay-descriptors/archives/
> KeepDirectoryArchiveImportHistory = false
> DirectoryAuthoritiesAddresses =
DownloadAllServerDescriptors = true
> DownloadAllExtraInfoDescriptors = true
> CompressRelayDescriptorDownloads = true BridgeSources = Local
> BridgeSyncOrigins = https://collector.torproject.org
> BridgeLocalOrigins = in/bridge-descriptors/
> ReplaceIpAddressesWithHashes = false BridgeDescriptorMappingsLimit
> = inf ExitlistSources = Remote ExitlistSyncOrigins =
> https://collector.torproject.org ExitlistUrl =
> https://check.torproject.org/exit-addresses TorperfHosts = torperf,
> TorperfFilesLines = torperf 51200 50kb.data 50kb.extradata,
> torperf 1048576 1mb.data 1mb.extradata, torperf 5242880 5mb.data
> 5mb.extradata _______________________________________________
> metrics-team mailing list metrics-team at lists.torproject.org
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - http://gpgtools.org
-----END PGP SIGNATURE-----
More information about the metrics-team