Google indexing question

GreyWyvern wrote:
 > On Tue, 4 Jan 2005 14:18:38 -0500, Viper <venomx.DeleteThis@gmail.com> wrote:
 >
  >> On my PPC search site I had to use <META name="robots"
  >> content="index,nofollow">
  >> because the google bot hit my keyword links I have on he index. The
  >> server
  >> couldnt handle it viewing all the different results on each page. Is
  >> there a
  >> way to make it follow everything BUT urls with search.php in them?
 >
 > From: <http://www.google.ca/intl/en/webmasters/faq.html#nocrawl> ...
 >
 > Try this in your robots.txt:
 >
 > User-Agent: Googlebot
 > Disallow: /search.php*
 >
 > Or send the NOINDEX meta with the search page.
 >
 > Grey

Thanks! Ill give that a try. Just remembered today I had the noindex in
there and my brain isnt working well because I have not had any sleep for 2
days because of a toothach. <!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

On Tue, 4 Jan 2005 14:18:38 -0500, "Viper" <venomx.RemoveThis@gmail.com> wrote:

 >On my PPC search site I had to use <META name="robots"
 >content="index,nofollow">
 >because the google bot hit my keyword links I have on he index. The server
 >couldnt handle it viewing all the different results on each page. Is there a
 >way to make it follow everything BUT urls with search.php in them?

Taking a guess here - but robots.txt file?

Carol<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

Viper wrote

 > I have not had any
 > sleep for 2 days because of a toothach.

Ouch!...he said after finishing three visits to the dentist to get a couple
of teeth repaired, one of which was aching!

That was a farce. I was a National Health Service patient, but still had
to pay £100! What's the bloody point of paying tax I asked?!

--
Charles Sweeney
<a style='text-decoration: underline;' href="http://CharlesSweeney.com" target="_blank">http://CharlesSweeney.com</a><!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

Charles Sweeney wrote:
 > Viper wrote
 >
 >
  >>I have not had any
  >>sleep for 2 days because of a toothach.
 >
 >
 > Ouch!...he said after finishing three visits to the dentist to get a couple
 > of teeth repaired, one of which was aching!
 >
 > That was a farce. I was a National Health Service patient, but still had
 > to pay £100! What's the bloody point of paying tax I asked?!
 >

My Vixen was told she had to pay £1000 to have her bridge replaced onthe
NHS, and have to wait 3 months. So she's now got AXA/PPP insurance for
£20 a month and having it done by the same denist on private next week.
Nothing is free... can believe it was 50 times the cost on NHS :/ Glad I
have full medical insurance thru work.

--


x theSpaceGirl (miranda)

# lead designer @ <a style='text-decoration: underline;' href="http://www.dhnewmedia.com" target="_blank">http://www.dhnewmedia.com</a> #
# remove NO SPAM to email, or use form on website #<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

Once upon a time, far far away, the king summoned SpaceGirl
<NOtheSpaceGirlSPAM.DeleteThis@subhuman.net> who replied:

 >Charles Sweeney wrote:
  >> Viper wrote
  >>
  >>
   >>>I have not had any
   >>>sleep for 2 days because of a toothach.
  >>
  >>
  >> Ouch!...he said after finishing three visits to the dentist to get a couple
  >> of teeth repaired, one of which was aching!
  >>
  >> That was a farce. I was a National Health Service patient, but still had
  >> to pay £100! What's the bloody point of paying tax I asked?!
  >>
 >
 >My Vixen was told she had to pay £1000 to have her bridge replaced onthe
 >NHS, and have to wait 3 months. So she's now got AXA/PPP insurance for
 >£20 a month and having it done by the same denist on private next week.
 >Nothing is free... can believe it was 50 times the cost on NHS :/ Glad I
 >have full medical insurance thru work.
 >

This really makes me MAD!

We ALL in the UK have health insurance. It's called "national
insurance" and costs us an arm and a leg (assuming we're in work). And
yet, it's a bloody joke. We have to buy into PPP or BUPA to get
treatment!

Sorry, I expect you feel the same <g>

Matt<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

Matt Probert wrote:
 > Once upon a time, far far away, the king summoned SpaceGirl
 > <NOtheSpaceGirlSPAM RemoveThis @subhuman.net> who replied:
 >
 >
  >>Charles Sweeney wrote:
  >>
   >>>Viper wrote
   >>>
   >>>
   >>>
   >>>>I have not had any
   >>>>sleep for 2 days because of a toothach.
   >>>
   >>>
   >>>Ouch!...he said after finishing three visits to the dentist to get a couple
   >>>of teeth repaired, one of which was aching!
   >>>
   >>>That was a farce. I was a National Health Service patient, but still had
   >>>to pay £100! What's the bloody point of paying tax I asked?!
   >>>
  >>
  >>My Vixen was told she had to pay £1000 to have her bridge replaced onthe
  >>NHS, and have to wait 3 months. So she's now got AXA/PPP insurance for
  >>£20 a month and having it done by the same denist on private next week.
  >>Nothing is free... can believe it was 50 times the cost on NHS :/ Glad I
  >>have full medical insurance thru work.
  >>
 >
 >
 > This really makes me MAD!
 >
 > We ALL in the UK have health insurance. It's called "national
 > insurance" and costs us an arm and a leg (assuming we're in work). And
 > yet, it's a bloody joke. We have to buy into PPP or BUPA to get
 > treatment!
 >
 > Sorry, I expect you feel the same <g>
 >
 > Matt
 >

Of course... I loose £30 a month of my wage, and Sirin £20 of hers
whether we get sick or not, and despite "free" NHS healthcare. £50 a
month is a big chunk when you consider 30%+ of our wages is gone in
taxes, part of which supposedly pays for the NHS.

It makes ME mad too that there is FAR better healthcare in Sirins native
country (Turkey) than the UK could ever hope for, for a fraction of the
cost and no waiting lists, in ultra-modern brand new hospital and
one-per-block (almost) private surgeries in cities like Istanbul.

We live in such a backwards country

--


x theSpaceGirl (miranda)

# lead designer @ <a style='text-decoration: underline;' href="http://www.dhnewmedia.com" target="_blank">http://www.dhnewmedia.com</a> #
# remove NO SPAM to email, or use form on website #<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

Viper wrote:


 > On my PPC search site I had to use <META name="robots"
 > content="index,nofollow">
 > because the google bot hit my keyword links I have on he index. The
 > server
 > couldnt handle it viewing all the different results on each page. Is
 > there a
 > way to make it follow everything BUT urls with search.php in them?


Since it's a PPC, don't oversimlify the issue. You may want to change your
search.php script so that it rejects requests from "googlebot" user agents
instead of just using nofollow: what if someones submits
<a style='text-decoration: underline;' href="http://www.yourhost.com/search.php" target="_blank">http://www.yourhost.com/search.php</a> to Google directly, just for fun? At
the very least make sure your script does not count (==charges your
customers for) clicks that came from the google and other SE bots.



Sincerely,
Dmitri
<a style='text-decoration: underline;' href="http://www.1-script.com/1_search/" target="_blank">http://www.1-script.com/1_search/</a>
Get search engine for your site
<a style='text-decoration: underline;' href="http://www.1-script.com/install/" target="_blank">http://www.1-script.com/install/</a>
Check out my CGI scripts installation offer

-------------------------------------


##-----------------------------------------------##
Article posted with Web Developer's USENET Archive
<a style='text-decoration: underline;' href="http://www.1-script.com/forums" target="_blank">http://www.1-script.com/forums</a>
no-spam read and post WWW interface to your favorite newsgroup -
alt.www.webmaster - 1508 messages and counting!
##-----------------------------------------------##<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

<a style='text-decoration: underline;' href="http://www.1-script.com" target="_blank">www.1-script.com</a> wrote:
 > Viper wrote:
 >
 >
  >> On my PPC search site I had to use <META name="robots"
  >> content="index,nofollow">
  >> because the google bot hit my keyword links I have on he index. The
  >> server
  >> couldnt handle it viewing all the different results on each page. Is
  >> there a
  >> way to make it follow everything BUT urls with search.php in them?
 >
 >
 > Since it's a PPC, don't oversimlify the issue. You may want to change
 > your search.php script so that it rejects requests from "googlebot"
 > user agents instead of just using nofollow: what if someones submits
 > <a style='text-decoration: underline;' href="http://www.yourhost.com/search.php" target="_blank">http://www.yourhost.com/search.php</a> to Google directly, just for fun?
 > At the very least make sure your script does not count (==charges your
 > customers for) clicks that came from the google and other SE bots.
 >
 >
It doesnt. It returns results but if it follows the results it will block
them. thing is it clicks EVERY result... LOL

I caught it before I blocked it at 40,000+ "hits" according to the stats
thing...<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

SpaceGirl wrote

 > My Vixen was told she had to pay £1000 to have her bridge replaced

Sorry Mir, but your posts seem to elicit this response from me:

Fuck me!

As you can tell, I don't get dental work done very often!

--
Charles Sweeney
<a style='text-decoration: underline;' href="http://CharlesSweeney.com" target="_blank">http://CharlesSweeney.com</a><!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question 

Viper wrote:

  >> It doesnt. It returns results but if it follows the results it will
 > block
 > them. thing is it clicks EVERY result... LOL

 > I caught it before I blocked it at 40,000+ "hits" according
 > to the stats
 > thing...

This is exactly what I'm talking about. In order to count the clicks you
have to feed the click into a script on your server (not search.php as far
as I can understand), which then counts the click and re-directs to the
actual URL. Therefore you need to modify THAT script, not search.php, so
that the clicks generated by Google (and others) are not counted.

Good luck!

Sincerely,
Dmitri
<a style='text-decoration: underline;' href="http://www.1-script.com/1_search/" target="_blank">http://www.1-script.com/1_search/</a>
Get search engine for your site
<a style='text-decoration: underline;' href="http://www.1-script.com/install/" target="_blank">http://www.1-script.com/install/</a>
Check out my CGI scripts installation offer

-------------------------------------





##-----------------------------------------------##
Article posted with Web Developer's USENET Archive
<a style='text-decoration: underline;' href="http://www.1-script.com/forums" target="_blank">http://www.1-script.com/forums</a>
no-spam read and post WWW interface to your favorite newsgroup -
alt.www.webmaster - 1813 messages and counting!
##-----------------------------------------------##<!-- ~MESSAGE_AFTER~ -->
 >> Stay informed about: Google indexing question