[tor-commits] [onionoo/master] Allow robots to index the .html files.

[karsten at torproject.org]

commit f5b85859b09ff8164acc82dbea27fb15cb713bc8
Author: Karsten Loesing <karsten.loesing at gmx.net>
Date:   Tue Aug 12 16:15:27 2014 +0200

    Allow robots to index the .html files.
---
 web/robots.txt |    7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)

diff --git a/web/robots.txt b/web/robots.txt
index 6ffbc30..9b19f8f 100644
--- a/web/robots.txt
+++ b/web/robots.txt
@@ -1,3 +1,8 @@
 User-agent: *
-Disallow: /
+Disallow: /summary
+Disallow: /details
+Disallow: /bandwidth
+Disallow: /weights
+Disallow: /clients
+Disallow: /uptime