prevent Google/Yahoo!/MSN spidering my webpage

Hi,

Am i safe enough with the following meta tags to prevent Google/Yahoo!/MSN Search from spidering my webpage?


<meta name="robots" content="noindex" />
<meta name="robots" content="nofollow" />
<meta name="robots" content="noarchive" />
<meta name="robots" content="noodp" />
<meta name="robots" content="noimageindex,nomediaindex" />
<meta name="robots" content="unavailable_after: 05-Apr-2009 22:00:00 CET" />
<meta name="googlebot" content="nosnippet" />
<meta name="slurp" content="noydir">


Cheers,
Picco

you can use disallow and the name of the bot in robots.txt.
noindex is only to not index your page.

best regards

http://www.google.com/support/webmasters/bin/answer.py?answer=35302

Nice one, thanks.

I have added a robots.txt to my server root, disallowing the one page that I don't want to appear in search results.


User-agent: *
Disallow: /picco.html


Does anyone know of a way to test this, short of doing a search on Google over the next couple of days.......

Picco

No need to use the robots.txt in the way you have and use the meta tags you have provided. Prolley just use one or the other.

In answere to your question


Am i safe enough with the following meta tags to prevent Google/Yahoo!/MSN Search from spidering my webpage?


Yes you are.

cheers, is there a test site out there where I can check if a search engine will be able to spider my page?

Thanks.

cheers, is there a test site out there where I can check if a search engine will be able to spider my page?

Thanks.

Try this:
http://tools.seobook.com/general/spider-test/

Try this:
http://tools.seobook.com/general/spider-test/
this will show how op site is seen by a spider not if it can be indexed or not.

best regards

cheers, is there a test site out there where I can check if a search engine will be able to spider my page?

You can test it from within Google Webmaster Tools itself if you have the site listed in your dashboard (verified owner).

Try to type this in the search box: site:www.yoursite.com
This will work for some search engines to check what pages of your web site are there.