Printer Friendly Version Print this thread
Email this thread to a friend eMail this thread to a friend
Related Forum Posts
Featured Web Site Template

Hundreds More at Free Site Templates.com!

Web Site Partners
Sponsored Links
 
Moderator(s): OAC, flyingrose
Member Message

bern
Joined: Jul 21, 2001
# Posts: 69

View the profile for bern Send bern a private message

Posted: 01/05/2006 05:12 am
Edit Message Delete Message Reply to this message

So its been years since I have been closely involved with web analytics. The last time I did so I was using cookie tracking with webtrends. I want to say that I used to filter out robot and spider IP adresses from the reporting as well.

I am now using indextools - is the practice of filtering spiders still in practice? Does doing so interfere with search engine & keyword referral reports?

Thanks




OAC
Moderator
Joined: Jan 25, 2001
# Posts: 6779

View the profile for OAC Send OAC a private message

Posted: 01/09/2006 04:51 pm
Edit Message Delete Message Reply to this message

"is the practice of filtering spiders still in practice?"

Yes

"Does doing so interfere with search engine & keyword referral reports?"

No. The log analyzers distinguish between refewrrals from search engines and the rest of the entries.

So why filter spiders from the log file analysis? I don't filter "ggod spiders" eg Googlebot as I want to know that the spiders from the major search engines are active. However, I filter nuisance spiders from the analysis because they distort the page views and hits numbers.

Alternatively, as some webmasters do, you could actually ban the IPs of the sources of such nuisance spiders, via the .htaccess file. Then your logs aren't polluted by their visits.




You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
  1. You have not yet logged in, or registered properly as a member
  2. You are a member, but no longer have posting rights.
  3. This is a private forum, for which you do not have permissions.

If you are a recent member, it's possible that you simply have not yet confirmed your account. Please check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions contained within.

If you cannot find this message, click here to Re-Send it.

If you are still experiencing problem, please read the Login Assistance Article for some advice on what may be causing your login not to work properly.

Switch to Advanced Editor and ... Create a New Topic or Reply to this Thread

New posts Forum is locked
© 1995  ·  iWeb, Inc  ·  DBA JimWorld Productions