[or-cvs] r22627: {website} update robots.txt to make it valid. (website/trunk)

[Andrew Lewman]

Author: phobos
Date: 2010-07-12 18:35:11 +0000 (Mon, 12 Jul 2010)
New Revision: 22627

Modified:
   website/trunk/robots.txt
Log:
update robots.txt to make it valid.


Modified: website/trunk/robots.txt
===================================================================
--- website/trunk/robots.txt	2010-07-11 02:54:33 UTC (rev 22626)
+++ website/trunk/robots.txt	2010-07-12 18:35:11 UTC (rev 22627)
@@ -1,3 +1,4 @@
 Sitemap: http://www.torproject.org/sitemap.xml
 Sitemap: https://www.torproject.org/sitemap.xml
 User-Agent: *
+Allow: /