[metrics-team] server-descriptor not readable (2018-02-08-11-05-00-server-descriptors has >30k descriptors)

[Karsten Loesing]

On 2018-02-09 10:26, Katharina Haselhorst wrote:
> Hi Karsten,
>> I just gave this a try and was able to parse the file in a bit under 20
>> minutes. I set -Xmx6g, though it might also work with less heap space.
> 
> Thx for trying out!
> 
>> So, this is a known limitation of metrics-lib which cannot handle large
>> descriptor files very well. We're tracking this bug here, just in case
>> you want to follow along:
> 
> I see. Does this limitation only apply to large files or also to large
> archieves (with many smaller files)?

Just to large files. Archives with many small files are not affected.

> Regards, Kathi

All the best,
Karsten

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 528 bytes
Desc: OpenPGP digital signature
URL: <http://lists.torproject.org/pipermail/metrics-team/attachments/20180209/a912a96f/attachment.sig>