Printer Friendly Version Print this thread
Email this thread to a friend eMail this thread to a friend
Related Forum Posts
  1. Question about Googlebot in Google Webmaster tools (In: Google)
Featured Web Site Template

Hundreds More at Free Site Templates.com!

Web Site Partners
Sponsored Links
Jet City Software
 
Whos Here ?
Reflects user activity within the last 5 minutes
Forum Index · Search Engine Forums · Optimizing Your Website for the Search Engines · Google · GoogleBot crawls - coincidence or pattern?
Member Message

phrail
Joined: Jan 09, 2008
# Posts: 61

View the profile for phrail Send phrail a private message

Posted: 01/30/2008 12:48 pm
Edit Message Delete Message Reply to this message

I have been monitoring each Googlebot crawl and it seems to me that I have found a SMALL pattern. Before their surge of visits the past couple of weeks, the last time they visited was Aug. 19, 25, 30 and Sep. 6 and 11 of 2007. Slowly I saw this pattern form again the past couple weeks when they started crawling again. They visited on Jan. 19, 25 and 30 just as I had predicted. Now I am awaiting for Feb. 6 and 11 to see if my theory is correct.(I only predicted on the 30th because I only saw the "pattern" form when I saw the dates of 19th and 25th.)

Now I am wondering if this is just coincidence or could possibly be some sort of pattern to the visits.

Have any of you experimented with the monitoring of googlebots? Did you see any sort of patterns to their visits?

I am really interested to hear any of your opinions/experiences.



g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10288

View the profile for g1smd Send g1smd a private message

Posted: 01/30/2008 01:21 pm
Edit Message Delete Message Reply to this message

There are patterns. They generally come back at reasonably regular intervals, often within minutes of the same time as last time. Some sites get an hourly or daily visit, others a few times per week, or a few times per month.



I just reviewed the log files for a site and noticed something interesting too. The Google Webmastertools Verification file is called something like: /GOOGLE7a48ae05ad895a39.html which it fetches a few times per month.

While looking at the site error logs I see that Google has also requested /noexist_7a48ae05ad895a39.html once or twice per month too. That looks like a way for them to test out what the 404 error page looks like (and confirm the 404 response) and detect certain types of site configuration error.


Forum Index · Search Engine Forums · Optimizing Your Website for the Search Engines · Google · GoogleBot crawls - coincidence or pattern?
You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
  1. You have not yet logged in, or registered properly as a member
  2. You are a member, but no longer have posting rights.
  3. This is a private forum, for which you do not have permissions.

If you are a recent member, it's possible that you simply have not yet confirmed your account. Please check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions contained within.

If you cannot find this message, click here to Re-Send it.

If you are still experiencing problem, please read the Login Assistance Article for some advice on what may be causing your login not to work properly.

Switch to Advanced Editor and ... Create a New Topic or Reply to this Thread

New posts Forum is locked
© 1995  ·  iWeb, Inc  ·  DBA JimWorld Productions