ensl.org/public/robots.txt

mirror of https://github.com/ENSL/ensl.org.git synced 2024-12-26 04:21:36 +00:00
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
# User-Agent: *
# Disallow: /
Purged git history and removed sensitive information. 2014-03-23 00:22:25 +00:00			`# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file`
			`#`
			`# To ban all spiders from the entire site uncomment the next two lines:`
			`# User-Agent: *`
			`# Disallow: /`