backdoor google access to registered website ..how?

[kab_184]

There have been many websites like

www.experts-exchange.com
www.emedicine.com

When u search google and find that what u looking for is on these websites..then u get access to that page.. but once u read that page on those websites..and u try to browse other pages it asks for registration first..

how do they give access to google to cache all pages without registering..but ask users to register first to read content?

[cycleops]

most likely, they feed google a different set of content than the content that you see. Either cloacking or they send a xml feed.

[ArcticFox]

On some forums it can be done by setting the googlebot (or any other spider/bot) as a "member", instead of just leaving them as "visitors".

[kab_184]

and how do u suggest ..googlebot logins into website then as member?

[ArcticFox]

I'm guessing it's auto recognition by the forums/site.

On my IPB forums, when I give bots "member" access, they crawl everywhere a registered (and logged in) member can go, without the process of logging in. There may be sections that are member-only where google will visit and cache the page; then people can find the page on searches, but if they try to move to another part of a member-only section, the forums will require them to register or log in. It's reasons like this why I'm careful about what group I assign google. If I assign the bots to an Admimistrator group, they'll be able to search the same (hidden) sections created for admins/mods.

I don't know how it works, it just does.

[Pennimus]

Well, if that's all it is just get an IP cloaker to set your user agent to Googlebot. It's not hard and will let you see all of the hidden content, if indeed that's the system they have used which I doubt (due to the ease with which it's circumnavigated).

[ArcticFox]

I'll try it.

But where can I find this IP cloaker?

[kab_184]

i found one via google

http://www.sellwide.com/sellwide_cloaker.shtml

Here's how it works (plain and simple):

1. Hits come to your site;

2. The Sellwide Cloaker automatically interprets whether this hit is a real person or a search engine spider;

3. If the hit is a spider, the Sellwide Cloaker feeds it with search engine optimized pages containing keywords that you specified. If the hit is a human, the SellWide Cloaker redirects them to your real page;

4. The search engine spiders take the "cloaked" pages of all the keywords you specified and store them in their files. Voila! You have just greatly increased your chances of higher placement in the search results.



now where is such thing avaialble for free?

A GOOD reading about cloaking

http://www.webreference.com/authoring/search_engines/cloaking/

[Pennimus]

Actually I wasn't tallking about cloaking for the purposes of serving the search engines different content (in order to increase your ranking) - a dangerous activity (look up the BMW cloaking "scandal" to see possible consequences!).

I was simply talking about finding an IP cloaker and setting your user agent to Googlebot so you could see loaked content yourself.

There are loads of IP cloakers out there, in fact I think there is a firefox extension that lets you set your user agent to googlebot through your menubar...

Yes, I think this could be it, although I haven't downloaded it to test - https://addons.mozilla.org/firefox/59/