Go Back   CodingForums.com > :: Server side development > Apache configuration

Before you post, read our: Rules & Posting Guidelines

Reply
 
Thread Tools Rate Thread
Enjoy an ad free experience by logging in. Not a member yet? Register.
Old 07-10-2011, 03:26 PM   PM User | #1
listerdl
Regular Coder

 
Join Date: Mar 2011
Posts: 157
Thanks: 7
Thanked 0 Times in 0 Posts
listerdl is an unknown quantity at this point
Is my robots.txt ok?

Obviously for SEO purposes I need to make sure that this has been done correctly, Id really appreciate your feedback on this thanks:

(This is for a Word Press Blog)

Main thing I guess is to see that there is no glaring mistake thanks!!!

User-agent: *
Allow: /
Disallow: /cgi-bin
Disallow: /7/wp-admin
Disallow: /7/wp-includes
Disallow: /7/wp-content/plugins
Disallow: /7/wp-content/cache
Disallow: /7/wp-content/themes
Disallow: /7/wp-register.php
Disallow: /7/wp-login.php

Sitemap: http://www.site/site_map.html
listerdl is offline   Reply With Quote
Old 07-11-2011, 01:01 AM   PM User | #2
Inigoesdr
Super Moderator


 
Inigoesdr's Avatar
 
Join Date: Mar 2007
Location: Florida, USA
Posts: 3,604
Thanks: 2
Thanked 399 Times in 392 Posts
Inigoesdr is a jewel in the roughInigoesdr is a jewel in the roughInigoesdr is a jewel in the rough
You probably want trailing slashes on those directories, but other than that it's ok. Just for reference Google's Webmaster Tools has a robots.txt validator & generator as well as some other useful tools.
Inigoesdr is offline   Reply With Quote
Reply

Bookmarks

Jump To Top of Thread


Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 10:32 PM.


Advertisement
Log in to turn off these ads.