httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Norman Khine <nor...@khine.net>
Subject [users@httpd] robots.txt and rewrite rule
Date Thu, 22 Jan 2009 17:29:35 GMT
Hello,
I have the following http.conf entry:

<VirtualHost *:80>
   ServerName domain.com
   ServerAlias www.domain.com
  <IfModule mod_rewrite.c>
     RewriteEngine On
     #DenyHosts Rules
     RewriteMap    hosts-deny      txt:/home/user/txt/hosts.deny
     RewriteCond   ${hosts-deny:%{REMOTE_HOST}|NOT-FOUND} !=NOT-FOUND [OR]
     RewriteCond   ${hosts-deny:%{REMOTE_ADDR}|NOT-FOUND} !=NOT-FOUND [OR]
     RewriteCond   ${hosts-deny:%{HTTP:true-client-ip}|NOT-FOUND} !=NOT-FOUND
     RewriteRule   ^/.*  -  [F]
     RewriteRule ^/(.*) http://localhost:12080/companies/$1 [P]
     RequestHeader set X-Base-Path companies/
  </IfModule>
   RewriteLogLevel 9
   RewriteLog /var/log/apache2/uk_rewrite.log
   ErrorLog       /var/log/apache2/uk_error.log
        <Directory "/var/www/localhost/htdocs">
                Options Indexes FollowSymLinks
                AllowOverride None
                Order allow,deny
                Allow from all
        </Directory>
</VirtualHost>

Is there a way I can put a robots.txt file to reside outside of the
rewrite, so that if a the bots look for http://domain.com/robots.txt
the rewrite does not push it to the
localhost:12080/companies/robots.txt

Cheers

Norman

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message