View Full Version : robots.txt & xml sitemap (multiple domains)

12-01-2008, 08:33 AM
Hi, I've got multiple websites at my hosting account. When somebody visits one of my websites he/she will be redirected to the correct subdirectory and html file, set in my .htaccess file.

Now I'm wondering how to setup the robots.txt and xml sitemap. They need to be in the root of my webhost? Or can I place them in each subdirectory (robots.txt and sitemap xml)? Where do search engines look for robots.txt?

Thanks in advance,

12-01-2008, 10:15 AM
You should place one for each web site in the corresponding folder of your host. Essentially, if they are redirected from your htaccess I believe they would never pick up the files if they are in the root. Also robots.txt is in the main folder for each site.