robots.txt

Both urls use /var/www/html. I want /var/www/html/robots.txt to work for ccl.flsh but not for compcanlit. Is this doable? Should I put it elsewhere and create an alias or a redirect?

<VirtualHost *>
ServerName ccl.flsh.usherbrooke.ca
DocumentRoot /var/www/html
</VirtualHost>
<VirtualHost *>
ServerName compcanlit.usherbrooke.ca
DocumentRoot /var/www/html
</VirtualHost>

--
John Taylor-Johnston
-----------------------------------------------------------------------------
°v° Bibliography of Comparative Studies in Canadian, Québec and Foreign Literatures
/(_)\ Université de Sherbrooke
^ ^ http://compcanlit.ca/

If I understand you correctly, this is what I think you want
to do. You want to have two domains going to the same subdirectory on
your Webserver. You want to have two separate robots.txt files, one
for each domain (http://www.domain1.com and <a style='text-decoration: underline;' href="http://www.domain2.com" target="_blank">http://www.domain2.com</a>).

  Well, you can't do it. The robots.txt file for each domain
must be in the main directory for the site. There can't be two
robots.txt files in the same directory.

  What you can do is have one file that blocks each subdirectory
separately. Example: <a style='text-decoration: underline;' href="http://www.domain1.com/myfirstpage" target="_blank">http://www.domain1.com/myfirstpage</a> and
<a style='text-decoration: underline;' href="http://www.domain2.com/mysecondpage." target="_blank">http://www.domain2.com/mysecondpage.</a>

  Make these entries in your robots.txt file and you will
prevent both pages from being scanned by the spiders:

   User-agent: *
   Disallow: /myfirstpage/
   Disallow: /mysecondpage/

  If I've misunderstood you, please understand it's late and I'm
a little tired.

  If this helps you, then I'm glad.

  There is a lot of information about robots.txt at
<a style='text-decoration: underline;' href="http://www.robotstxt.org." target="_blank">http://www.robotstxt.org.</a>

  Regards,


    Fred<!-- ~MESSAGE_AFTER~ -->