Welcome to MobyThreads.com!
FAQFAQ   SearchSearch      ProfileProfile    Private MessagesPrivate Messages   Log inLog in
All support for the MobyThreads Threaded phpBB MOD can now be found on welsolutions at this forum

New Googlebot string?

  
   Web Hosting and Web Master Forums (Home) -> Webmaster RSS
Related Topics:
Googlebot Question - Hi, I have 4 sites all hosted by Yahoo. From the website logs, I see that 2 of the sites get visited by Googlebot every few days, but the other 2 sites haven't been visited by Googlebot during the past 2 months. Is this normal? I wonder how..

Can Googlebot,etc artifically boost your traffic? - If you have a 500 page web site, could your traffic be boosted if Googlebot and MSNbot visit your site and index all the pages? 4 bots and that would be 2,000 views. That is assuming a bot visit registers as a page view, is that true or not?

PHP googlebot detector, does this code work? - I found this code on Does this really detect the freshie and deep bots ? Thanks for any info.

php string split - how can i split some string using subsring as for example.. i have this string.. i want to use as delimiter so i can get this in array...

Simple PHP ? - Match words in a string - This is a simple one. I have a string a few hundred long being fed to a php script. I want the script to break down the string into words, then check them for matches against a MySQL database. The final step is to print the..
Next:  [OT] Top 10 Signs your Mate my be having an Onlin..  
Author Message
user387

External


Since: Feb 13, 2004
Posts: 1055



(Msg. 1) Posted: Thu Sep 09, 2004 10:19 pm
Post subject: New Googlebot string?
Archived from groups: alt>www>webmaster (more info?)
Up till yesterday, the Googlebot entries in my logs looked like
this:
64.68.82.170 - - [08/Sep/2004:01:08:07 -0400] "GET / HTTP/1.0"
200 5198 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"

But yesterday and today it seems to have changed to

64.68.83.173 - - [09/Sep/2004:04:56:28 -0400] "GET / HTTP/1.1"
200 2025 "-" "Mozilla/5.0 (compatible; Googlebot/2.1;
+http://www.google.com/bot.html)"

Also it is now checking the complete site in a very fast tempo,
about 1 page per minute. Used to be anywhere between 10 minutes
and a couple of hours between hits.

Anyone else noticed a difference?
Any ideas why the useragent string has been changed?

--
Els
http://locusmeus.com/
Sonhos vem. Sonhos vão. O resto é imperfeito.
- Renato Russo -

 >> Stay informed about: New Googlebot string? 
Back to top
Login to vote
usewebsiteinsi1

External


Since: Aug 30, 2004
Posts: 71



(Msg. 2) Posted: Thu Sep 09, 2004 11:21 pm
Post subject: Re: New Googlebot string? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
*Els* wrote in alt.www.webmaster:
 > Up till yesterday, the Googlebot entries in my logs looked like
 > this:
Googlebot/2.1 (+http://www.google.com/bot.html)

 > But yesterday and today it seems to have changed to
 >
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

 > Also it is now checking the complete site in a very fast tempo,
 > about 1 page per minute. Used to be anywhere between 10 minutes
 > and a couple of hours between hits.
 >
 > Anyone else noticed a difference?

</AOL>
As of 3a.m. GMT today; not sure about hits being more frequent though,
perhaps.

 > Any ideas why the useragent string has been changed?

Not really, only that it'd be a handy way of catching out some of the
developers that serve different content to Google - in an attempt to
influence ranking - than they do to other users.
--
Andrew Urquhart
- FAQ: <a style='text-decoration: underline;' href="http://www.aww-faq.org" target="_blank">http://www.aww-faq.org</a>
- Archive: <a style='text-decoration: underline;' href="http://www.google.com/groups?q=alt.www.webmaster" target="_blank">http://www.google.com/groups?q=alt.www.webmaster</a>
- Contact me: <a style='text-decoration: underline;' href="http://andrewu.co.uk/contact/" target="_blank">http://andrewu.co.uk/contact/</a><!-- ~MESSAGE_AFTER~ -->

 >> Stay informed about: New Googlebot string? 
Back to top
Login to vote
user387

External


Since: Feb 13, 2004
Posts: 1055



(Msg. 3) Posted: Thu Sep 09, 2004 11:42 pm
Post subject: Re: New Googlebot string? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
Andrew Urquhart wrote:

 > *Els* wrote in alt.www.webmaster:
  >> Up till yesterday, the Googlebot entries in my logs looked
  >> like this:
  >> Googlebot/2.1 (+http://www.google.com/bot.html)
  >> But yesterday and today it seems to have changed to
  >> Mozilla/5.0 (compatible; Googlebot/2.1;
  >> +http://www.google.com/bot.html)
  >>
  >> Any ideas why the useragent string has been changed?
 >
 > Not really, only that it'd be a handy way of catching out
 > some of the developers that serve different content to
 > Google - in an attempt to influence ranking - than they do
 > to other users.

I was thinking of that possibility, but is "Mozilla/5.0
(compatible;" enough to fool those browsersniffers?

--
Els <a style='text-decoration: underline;' href="http://locusmeus.com/" target="_blank">http://locusmeus.com/</a>
Sonhos vem. Sonhos vão. O resto é imperfeito.
- Renato Russo -
Now playing: Joe Jackson & Elaine Caswell - Happy Ending<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: New Googlebot string? 
Back to top
Login to vote
usewebsiteinsi1

External


Since: Aug 30, 2004
Posts: 71



(Msg. 4) Posted: Fri Sep 10, 2004 12:20 am
Post subject: Re: New Googlebot string? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
*Els* wrote in alt.www.webmaster:
 > Andrew Urquhart wrote:
 >
  >> *Els* wrote in alt.www.webmaster:
   >>> Up till yesterday, the Googlebot entries in my logs looked
   >>> like this:
   >>> Googlebot/2.1 (+http://www.google.com/bot.html)
   >>> But yesterday and today it seems to have changed to
   >>> Mozilla/5.0 (compatible; Googlebot/2.1;
   >>> +http://www.google.com/bot.html)
   >>>
   >>> Any ideas why the useragent string has been changed?
  >>
  >> Not really, only that it'd be a handy way of catching out
  >> some of the developers that serve different content to
  >> Google - in an attempt to influence ranking - than they do
  >> to other users.
 >
 > I was thinking of that possibility, but is "Mozilla/5.0
 > (compatible;" enough to fool those browsersniffers?

Depends; if the content cloaking was only acting on the complete
original user-agent and not just a 'Google' fragment or looking at IPs
then it could be enough. There are smarter ways to catch cloaks though,
so I'd assume there's another reason for the change.
--
Andrew Urquhart
- Contact me: <a style='text-decoration: underline;' href="http://andrewu.co.uk/contact/" target="_blank">http://andrewu.co.uk/contact/</a>
- 'Staccato signals of constant information
A loose affiliation of millionaires and billionaires' - Paul Simon<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: New Googlebot string? 
Back to top
Login to vote
user387

External


Since: Feb 13, 2004
Posts: 1055



(Msg. 5) Posted: Fri Sep 10, 2004 1:04 pm
Post subject: Re: New Googlebot string? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
Andrew Urquhart wrote:

 > *Els* wrote in alt.www.webmaster:
  >> Andrew Urquhart wrote:
  >>
   >>> *Els* wrote in alt.www.webmaster:
   >>>> Up till yesterday, the Googlebot entries in my logs
   >>>> looked like this:
   >>>> Googlebot/2.1 (+http://www.google.com/bot.html)
   >>>> But yesterday and today it seems to have changed to
   >>>> Mozilla/5.0 (compatible; Googlebot/2.1;
   >>>> +http://www.google.com/bot.html)
   >>>>
   >>>> Any ideas why the useragent string has been changed?
   >>>
   >>> Not really, only that it'd be a handy way of catching out
   >>> some of the developers that serve different content to
   >>> Google - in an attempt to influence ranking - than they
   >>> do to other users.
  >>
  >> I was thinking of that possibility, but is "Mozilla/5.0
  >> (compatible;" enough to fool those browsersniffers?
 >
 > Depends; if the content cloaking was only acting on the
 > complete original user-agent and not just a 'Google'
 > fragment or looking at IPs then it could be enough. There
 > are smarter ways to catch cloaks though, so I'd assume
 > there's another reason for the change.

Update:
This morning it was back to Googlebot/2.1
(+http://www.google.com/bot.html)...

Maybe they're using two different bots, one regular as they
used to, and a new one to check other stuff somehow? Funny...

--
Els <a style='text-decoration: underline;' href="http://locusmeus.com/" target="_blank">http://locusmeus.com/</a>
Sonhos vem. Sonhos vão. O resto é imperfeito.
- Renato Russo -
Now playing: Anita Ward - Ring My Bell<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: New Googlebot string? 
Back to top
Login to vote
spamblocked

External


Since: Sep 14, 2004
Posts: 588



(Msg. 6) Posted: Fri Sep 10, 2004 9:37 pm
Post subject: Re: New Googlebot string? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
Els wrote:
 > ...
 > Update:
 > This morning it was back to Googlebot/2.1
 > (+http://www.google.com/bot.html)...

Couyld be the other bot was a scammer trying to hide behind the google
identification?

 > Maybe they're using two different bots, one regular as they
 > used to, and a new one to check other stuff somehow? Funny...

Best pay attention - see what else (if anything) occurs.

--
William Tasso - read 'em, else the puppy gets it:
<a style='text-decoration: underline;' href="http://www.aww-faq.org/" target="_blank">http://www.aww-faq.org/</a>
<a style='text-decoration: underline;' href="http://www.catb.org/~esr/faqs/smart-questions.html" target="_blank">http://www.catb.org/~esr/faqs/smart-questions.html</a>
<a style='text-decoration: underline;' href="http://groups.google.com/groups?as_ugroup=alt.www.webmaster" target="_blank">http://groups.google.com/groups?as_ugroup=alt.www.webmaster</a><!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: New Googlebot string? 
Back to top
Login to vote
user387

External


Since: Feb 13, 2004
Posts: 1055



(Msg. 7) Posted: Fri Sep 10, 2004 9:39 pm
Post subject: Re: New Googlebot string? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
William Tasso wrote:

 > Els wrote:
  >> ...
  >> Update:
  >> This morning it was back to Googlebot/2.1
  >> (+http://www.google.com/bot.html)...
 >
 > Couyld be the other bot was a scammer trying to hide behind
 > the google identification?

Only if he can forge his IP, it was one of Google's.

  >> Maybe they're using two different bots, one regular as
  >> they used to, and a new one to check other stuff somehow?
  >> Funny...
 >
 > Best pay attention - see what else (if anything) occurs.

I always pay attention Smile
Well, almost always...

--
Els <a style='text-decoration: underline;' href="http://locusmeus.com/" target="_blank">http://locusmeus.com/</a>
Sonhos vem. Sonhos vão. O resto é imperfeito.
- Renato Russo -
Now playing: Kirsty MacColl - A New England<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: New Googlebot string? 
Back to top
Login to vote
Display posts from previous:   
   Web Hosting and Web Master Forums (Home) -> Webmaster All times are: Pacific Time (US & Canada) (change)
Page 1 of 1

 
 You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



[ Contact us | Terms of Service/Privacy Policy ]