View Full Version : Crawler messing up statistics

01-23-2003, 09:39 AM

I have a problem with a little statistics procedure that I have written to keep track of the site I'm developing.
The idea is to log a visitor when he/she visits the page and increase the counter if they have visited the page for the first time that day (depending on the Session variable and cookie value).
But there is a problem - every couple of days I see a lot of visits, made within a few minutes. Because the site is not public yet, I'm guessing it's the crawler of the search engine I'm testing.

So, my question is: how can I determine whether it's crawler or not.

Do you also have any suggestion how to track a visitor if he/she has cookies dsabled - I don't want to use IP number for this as I don't think it's reliable.


01-23-2003, 01:42 PM
Hmm. Without using IP, i wouldn't know.

I'd check for the IP in my global.asa, before increasing the counter. To see what IP's should be ignored, i'd search the log-file. It will (initially) take some work, but i wouldn't know an alternative.

Anyone else ?