[tor-bugs] #19437 [Metrics/Onionoo]: Find more reliable and universal way to get ASN and ASorg mappings

[Tor Bug Tracker & Wiki]

#19437: Find more reliable and universal way to get ASN and ASorg mappings
-------------------------------------------------+-------------------------
 Reporter:  twim                                 |          Owner:
     Type:  project                              |         Status:  new
 Priority:  Medium                               |      Milestone:
Component:  Metrics/Onionoo                      |        Version:
 Severity:  Normal                               |     Resolution:
 Keywords:  asn, as, geoip, maxmind, bgp,        |  Actual Points:
  organisations, diversity                       |         Points:
Parent ID:                                       |        Sponsor:
 Reviewer:                                       |
-------------------------------------------------+-------------------------

Comment (by cypherpunks):

 As a stopgap solution for the currently broken MaxMind DB, I trying to
 repair at least nameless  maxmind entries with data from
 http://thyme.apnic.net/current/data-used-autnums

 quick'n dirty solution (this reduces nameless AS entries by 49k records):
 {{{
 #convert data-used-autnums into a csv file and prefix AS numbers with "AS"
 sed 's/^[ \t]*//' data-used-autnums.orig | sed 's/ /,/'|sed 's/"//g'|awk
 '{ print "AS" $0 }'|sort -t, -k 1b,1 > data-used-autnums.csv

 #get all maxmind entries without AS names
 grep -v '"' GeoIPASNum2.csv.orig |sort -t, -k 3 > nameless_AS_entries
 join -o 1.1,1.2,1.3,2.2 -a 1  -t, -1 3 -2 1  nameless_AS_entries data-
 used-autnums.csv|awk -F, '{ print $1 "," $2 ",." $3 " " $4 "."}'|sed
 's,\.,",g'  > repaired_entries
 grep '"' GeoIPASNum2.csv.orig > entries_with_names
 cat entries_with_names repaired_entries > GeoIPASNum2.csv.partially-
 repaired
 }}}

 Note: also records with AS names are broken (but I'm not touching them)
 https://lists.torproject.org/pipermail/tor-dev/2016-June/011095.html

 would be great to have at least a workaround deployed soon - otherwise
 I'll have to postprocess onionoo data before using it.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/19437#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online