Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 8 of 8
  1. #1
    Senior Coder
    Join Date
    Jun 2008
    Location
    Cornwall
    Posts
    2,097
    Thanks
    297
    Thanked 12 Times in 12 Posts

    Exclamation how do i prevent a page from being included in a search engine results?

    Hi all,

    i have a page which updates my db but it is currently appearing within googles search results which means people can run my script and update my db if they view this page

    how do i prevent it from showing up in the search results???

    thanks
    Luke

  • #2
    Regular Coder
    Join Date
    Jan 2009
    Posts
    316
    Thanks
    7
    Thanked 92 Times in 91 Posts
    You can use a robots.txt file to block access to the page.

    If the problem is google specific, you can sign up for google webmaster tools. You'll find a section under crawler access that allows you to remove URLs from showing.

  • #3
    Supreme Master coder! abduraooft's Avatar
    Join Date
    Mar 2007
    Location
    N/A
    Posts
    14,851
    Thanks
    160
    Thanked 2,223 Times in 2,210 Posts
    Blog Entries
    1
    i have a page which updates my db but it is currently appearing within googles search results which means people can run my script and update my db if they view this page
    Have you linked that page anywhere in your site? Anyway, you must add some protection to your page, if it's not indented for public users to access.
    The Dream is not what you see in sleep; Dream is the thing which doesn't let you sleep. --(Dr. APJ. Abdul Kalam)

  • #4
    Senior Coder
    Join Date
    Jun 2008
    Location
    Cornwall
    Posts
    2,097
    Thanks
    297
    Thanked 12 Times in 12 Posts
    hi guys, thanks for your replys

    @Fisher - im not sure if it is google specific, but im signed up to google webmasters, i'll have a look into removing urls from showing, how do i create a robot.txt file to block access to it? thanks.

    @abduraooft - i haven't linked to the page anywhere on my site, what sort of protection are we talking about?

    thanks guys
    Luke

  • #5
    The fat guy next door VIPStephan's Avatar
    Join Date
    Jan 2006
    Location
    Halle (Saale), Germany
    Posts
    8,624
    Thanks
    6
    Thanked 1,001 Times in 974 Posts
    Luke, do a search for “robots.txt”. Ah well, it takes more time to write this here than to search for helpful articles about it but here you go: http://robotstxt.org/

    As to protection we’re talking about either a password protection (htaccess?) or some function in the server side script that is checking whether the script is called from some other page or directly in the browser or whatever (I’m not well versed in this). At least it must not be directly accessible from typing its URL into the browser’s address bar (then it won’t be searchable anyway).

  • #6
    Senior Coder
    Join Date
    Jun 2008
    Location
    Cornwall
    Posts
    2,097
    Thanks
    297
    Thanked 12 Times in 12 Posts
    ah ok thanks mate.

  • #7
    Regular Coder
    Join Date
    Nov 2007
    Posts
    110
    Thanks
    0
    Thanked 1 Time in 1 Post
    Instead of using robot.txt better use

    <meta name="robots" content="noindex"> for all

    <meta name="googlebot" content="noindex"> for Google only

  • #8
    The fat guy next door VIPStephan's Avatar
    Join Date
    Jan 2006
    Location
    Halle (Saale), Germany
    Posts
    8,624
    Thanks
    6
    Thanked 1,001 Times in 974 Posts
    And why is this better, if I may ask?


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •