...

View Full Version : Avoid Page Indexing by SE's but Allow Other Links to be Indexed



thekevin07
04-24-2008, 04:04 AM
I have a url like



http://mysite.com/products/


this is page one. The page 2 url is like this



http://mysite.com/products/pg2/


My question is how can I avoid having the http://mysite.com/parameter/pg2/ page indexed by google or the other search engines but have the links on that page 2 page followed and indexed?

Thanks

gnomeontherun
04-24-2008, 05:13 AM
You need a robots.txt file placed at the root of your website. Inside put


User-agent: *
Disallow: /parameter/pg2/

http://www.robotstxt.org/

Pennimus
04-24-2008, 10:32 AM
You need a robots.txt file placed at the root of your website. Inside put

Code:

User-agent: *
Disallow: /parameter/pg2/

http://www.robotstxt.org/

This will not allow the links from page 2 to be indexed like the OP wants.

Try:


<meta name="robots" content="noarchive, follow, noindex" />

gnomeontherun
04-24-2008, 03:12 PM
Yes true, I misread the post.

Angie1313
04-24-2008, 04:34 PM
Well I was going to say to add a simple nofollow buy you beat me to it Pennimus. lol

thekevin07
04-24-2008, 06:40 PM
This will not allow the links from page 2 to be indexed like the OP wants.

Try:


<meta name="robots" content="noarchive, follow, noindex" />

Perfect thanks



EZ Archive Ads Plugin for vBulletin Copyright 2006 Computer Help Forum