PDA

View Full Version : Question about web access?


Scke_Xival
03-15-2003, 06:02 PM
Am I correct that placing robot.txt in a dir prevents web browsers from searching that dir? Is there a more effective metheod?

Also, I forget how to change it. But how do you make it so that you make a customized error page if the address they entered does not exist.

Thanks

Borgtex
03-15-2003, 07:39 PM
No, a robots.txt file will not stop spiders solely for it's existence.
You have to add exclusion parameters. Look at http://www.robotstxt.org/ for more information