get my site off the search engines

Bob42 · 06-07-2008, 06:00 AM

My friend and I were working on a website. We don't want the public to see it until it is finished. Unfortunately, Google found the site and now anyone can view it from the search engine. Is there any way to take my site off search engines temporarily? If not, what procedures can I take to stop guests from viewing the site?

gnomeontherun · 06-07-2008, 06:11 AM

You would have to change the pages that are indexed with either a blank page or a dreaded under construction page. Hide the work-in-progress inside a folder that NOBODY has a link to. Also, put nofollow instructions for the web crawlers.

Are many people really finding it yet? I guess if its not many are finding it its probably not a huge deal. I don't think there are any ways to get yourself out of the listing though.

Bob42 · 06-07-2008, 06:22 AM

That could work. Right now I was thinking of implementing my login form on the index page, and the people who should have access would have to login in order to see the website. Would that work?
Not many people have found the site yet. The only reason I knew that it was listed on Google was because someone had used my registration form and registered.

abduraooft · 06-07-2008, 08:41 AM

Put a robots.txt file in the root directory having

Code:

user-agent:*
Disallow:/

NancyJ · 06-07-2008, 08:47 AM

using a robots.txt will prevent further spidering but you can just ask google to remove the pages from the index.