...

View Full Version : Is my robots.txt ok?



listerdl
07-10-2011, 04:26 PM
Obviously for SEO purposes I need to make sure that this has been done correctly, Id really appreciate your feedback on this thanks:

(This is for a Word Press Blog)

Main thing I guess is to see that there is no glaring mistake thanks!!!

User-agent: *
Allow: /
Disallow: /cgi-bin
Disallow: /7/wp-admin
Disallow: /7/wp-includes
Disallow: /7/wp-content/plugins
Disallow: /7/wp-content/cache
Disallow: /7/wp-content/themes
Disallow: /7/wp-register.php
Disallow: /7/wp-login.php

Sitemap: http://www.site/site_map.html

Inigoesdr
07-11-2011, 02:01 AM
You probably want trailing slashes on those directories, but other than that it's ok. Just for reference Google's Webmaster Tools (https://www.google.com/webmasters/tools/) has a robots.txt validator & generator as well as some other useful tools.



EZ Archive Ads Plugin for vBulletin Copyright 2006 Computer Help Forum