[metrics-bugs] #32231 [Metrics/CollecTor]: Lost some metrics due to broker host migration

[Tor Bug Tracker & Wiki]

#32231: Lost some metrics due to broker host migration
-------------------------------+------------------------------
 Reporter:  cohosh             |          Owner:  metrics-team
     Type:  defect             |         Status:  new
 Priority:  Medium             |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+------------------------------

Comment (by karsten):

 So, the issue is that there are two brokers running at the same time and
 you want both metrics to be archived by CollecTor?

 Here's what I found in CollecTor's tarballs from the past few weeks:

 {{{
 $ grep -R "snowflake-ips-total" * | sort | tail -n20
 snowflakes-2019-10/10/2019-10-10-14-18-42-snowflake-stats:snowflake-ips-
 total 3951
 snowflakes-2019-10/12/2019-10-12-14-29-08-snowflake-stats:snowflake-ips-
 total 3481
 snowflakes-2019-10/13/2019-10-13-14-29-08-snowflake-stats:snowflake-ips-
 total 3108
 snowflakes-2019-10/14/2019-10-14-14-29-08-snowflake-stats:snowflake-ips-
 total 3409
 snowflakes-2019-10/15/2019-10-15-14-29-08-snowflake-stats:snowflake-ips-
 total 3848
 snowflakes-2019-10/16/2019-10-16-14-29-08-snowflake-stats:snowflake-ips-
 total 3925
 snowflakes-2019-10/16/2019-10-16-16-28-15-snowflake-stats:snowflake-ips-
 total 0
 snowflakes-2019-10/17/2019-10-17-14-29-08-snowflake-stats:snowflake-ips-
 total 4106
 snowflakes-2019-10/17/2019-10-17-16-28-15-snowflake-stats:snowflake-ips-
 total 0
 snowflakes-2019-10/18/2019-10-18-19-44-19-snowflake-stats:snowflake-ips-
 total 1
 snowflakes-2019-10/19/2019-10-19-19-44-19-snowflake-stats:snowflake-ips-
 total 0
 snowflakes-2019-10/20/2019-10-20-19-44-19-snowflake-stats:snowflake-ips-
 total 0
 snowflakes-2019-10/21/2019-10-21-19-44-19-snowflake-stats:snowflake-ips-
 total 1
 snowflakes-2019-10/22/2019-10-22-19-44-19-snowflake-stats:snowflake-ips-
 total 1
 snowflakes-2019-10/23/2019-10-23-19-44-19-snowflake-stats:snowflake-ips-
 total 1
 snowflakes-2019-10/24/2019-10-24-19-44-19-snowflake-stats:snowflake-ips-
 total 0
 snowflakes-2019-10/25/2019-10-25-19-44-19-snowflake-stats:snowflake-ips-
 total 0
 snowflakes-2019-10/26/2019-10-26-19-44-19-snowflake-stats:snowflake-ips-
 total 0
 snowflakes-2019-10/27/2019-10-27-19-44-19-snowflake-stats:snowflake-ips-
 total 0
 snowflakes-2019-10/28/2019-10-28-19-44-19-snowflake-stats:snowflake-ips-
 total 0
 }}}

 It looks like you added the new broker around 2019-10-16 and had the old
 broker publish its stats until 2019-10-17.

 If archiving both files is the plan, I wonder how to tell the two apart
 from stats contents. There's no identity or nickname of any kind in the
 files. Would you want to include such a thing?

 Or are you asking to switch from one broker to the other, stats-wise, by
 (manually) deleting files, so that files from the old broker end on day
 '''x''' and files from the new broker start on day '''x+1'''?

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/32231#comment:1>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online