[tor-bugs] #12522 [Metrics/Website]: Add sitemap.xml to make Relay Search pages indexed by Google et al. (was: Add sitemap.xml to Globe to make details pages indexed by Google et al.)

[Tor Bug Tracker & Wiki]

#12522: Add sitemap.xml to make Relay Search pages indexed by Google et al.
-----------------------------+------------------------------
 Reporter:  karsten          |          Owner:  metrics-team
     Type:  enhancement      |         Status:  assigned
 Priority:  Medium           |      Milestone:
Component:  Metrics/Website  |        Version:
 Severity:  Normal           |     Resolution:
 Keywords:  metrics-2018     |  Actual Points:
Parent ID:                   |         Points:
 Reviewer:                   |        Sponsor:
-----------------------------+------------------------------
Changes (by irl):

 * parent:  #23518 =>


Old description:

> Right now, Google doesn't index Globe details pages.  We should consider
> changing that.  Discussed with Virgil and Moritz.
>
> One way to provide this file is to fetch the full
> `https://onionoo.torproject.org/summary` and generate the details page
> URLs from that.  Caching the Onionoo summary file and using the `If-
> Modified-Modified` header would be very much appreciated here.

New description:

 Right now, Google doesn't index Relay Search details pages.

 One way to provide this file is to fetch the full
 `https://onionoo.torproject.org/summary` and generate the details page
 URLs from that.  Caching the Onionoo summary file and using the `If-
 Modified-Modified` header would be very much appreciated here.

 The specification for sitemap.xml can be found at:

 https://www.sitemaps.org/index.html

--

Comment:

 This is not a requirement for #23518, only enabled by it. Enough of #23518
 has now been implemented that we can implement this when we are ready to
 do so.

 Updated the summary and description to reflect what this ticket would
 actually want now.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/12522#comment:9>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online