Go Back   CodingForums.com > :: Client side development > General web building

Before you post, read our: Rules & Posting Guidelines

Reply
 
Thread Tools Rate Thread
Enjoy an ad free experience by logging in. Not a member yet? Register.
Old 07-04-2009, 03:47 PM   PM User | #1
jasonc310771
Regular Coder

 
Join Date: Mar 2006
Posts: 478
Thanks: 3
Thanked 0 Times in 0 Posts
jasonc310771 can only hope to improve
websense keeps accessing my sites ?

I have noticed for some time that websense.com 208.80.195.34 has been accessing my sites on my server. sometimes the last two nmbers of the ip change but it is always websense

who are they and why would they visit all of my sites even when i create a new account on the server they seem to find this site with in hours of it being created!!

i do not have any connection with them or have an account, and from what i see they do not see to be a search engine site, just a security company and other things but none that connect with my sites in any way.


any suggestions ??

thanks
jasonc310771 is offline   Reply With Quote
Old 07-08-2009, 12:50 PM   PM User | #2
udjamaflip
Regular Coder

 
Join Date: Mar 2008
Posts: 235
Thanks: 6
Thanked 21 Times in 20 Posts
udjamaflip is an unknown quantity at this point
This is normal, ignore it. You'll find 100s of bots will be trawling your website all the time, some for search engines, some data farming, some for websites like this that check around to find known malicious websites.

hope it helps!
__________________
Andrew Sharman
Web designer, developer and programmer.

If you found my post helpful, why not give thanks! :)
udjamaflip is offline   Reply With Quote
Old 07-13-2009, 03:19 AM   PM User | #3
ragol_67
Regular Coder

 
Join Date: Sep 2002
Location: Calgary, AB
Posts: 179
Thanks: 0
Thanked 0 Times in 0 Posts
ragol_67 is an unknown quantity at this point
It is possible to stop bots from accessing your site by adding a 'robots.txt' file to your directory. In this file you can specify which bots to disallow and the directories to block them from.


Code:
user-agent: *
disallow: /
This tells all bots that they are not allowed to crawl your page. If you look at the name of the websense bot, then you can replace the asterik with the name of that bot, and that will prevent specifically that bot from accessing your website. The 'disallow' field is the directory to block the bot from. A '/' means all directories.
ragol_67 is offline   Reply With Quote
Reply

Bookmarks

Jump To Top of Thread


Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 04:38 PM.


Advertisement
Log in to turn off these ads.