Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 2 of 2
  1. #1
    Regular Coder
    Join Date
    Mar 2011
    Posts
    164
    Thanks
    7
    Thanked 0 Times in 0 Posts

    Is my robots.txt ok?

    Obviously for SEO purposes I need to make sure that this has been done correctly, Id really appreciate your feedback on this thanks:

    (This is for a Word Press Blog)

    Main thing I guess is to see that there is no glaring mistake thanks!!!

    User-agent: *
    Allow: /
    Disallow: /cgi-bin
    Disallow: /7/wp-admin
    Disallow: /7/wp-includes
    Disallow: /7/wp-content/plugins
    Disallow: /7/wp-content/cache
    Disallow: /7/wp-content/themes
    Disallow: /7/wp-register.php
    Disallow: /7/wp-login.php

    Sitemap: http://www.site/site_map.html

  • #2
    Super Moderator Inigoesdr's Avatar
    Join Date
    Mar 2007
    Location
    Florida, USA
    Posts
    3,638
    Thanks
    2
    Thanked 404 Times in 396 Posts
    You probably want trailing slashes on those directories, but other than that it's ok. Just for reference Google's Webmaster Tools has a robots.txt validator & generator as well as some other useful tools.


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •