qf/website
0
0
Fork 0
mirror of https://git.code.sf.net/p/quake/website synced 2024-11-10 07:11:43 +00:00
Code Issues Projects Releases Packages Wiki Activity

Add a robots.txt to keep engines from crawling ViewCVS.

Browse source
This commit is contained in:
Jeff Teunissen 2004-03-16 12:31:28 +00:00
parent 35fb99c523
commit 8c6fbb062e
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
robots.txt Normal file
View file

@ -0,0 +1,3 @@
User-agent: *
# exclude CGI stuff -- it really screws with searches.
Disallow: /cgi-bin/*