qf
/
website
mirror of https://git.code.sf.net/p/quake/website
0
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Add a robots.txt to keep engines from crawling ViewCVS.

This commit is contained in:
Jeff Teunissen 2004-03-16 12:31:28 +00:00
parent 35fb99c523
commit 8c6fbb062e
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
robots.txt Normal file
View File

@ -0,0 +1,3 @@
User-agent: *
# exclude CGI stuff -- it really screws with searches.
Disallow: /cgi-bin/*