httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Norman Khine <nor...@khine.net>
Subject Re: [users@httpd] robots.txt and rewrite rule
Date Thu, 22 Jan 2009 20:46:04 GMT
Hi, sorry, but this did not work.
As now when I type the http://domain.com/robots.txt the page returned
is from within my cms application and not from the default

I am using the python framework itools (http://www.hforge.org) and
this has in its URI a semi-column i.e. http://www.hforge.org/;view

Can I call my robots.txt file anything?

Cheers

Norman

On Thu, Jan 22, 2009 at 6:40 PM, Bob Ionescu <bobsiegen@googlemail.com> wrote:
> 2009/1/22 Norman Khine <norman@khine.net>:
>> Is there a way I can put a robots.txt file to reside outside of the
>> rewrite, so that if a the bots look for http://domain.com/robots.txt
>> the rewrite does not push it to the
>> localhost:12080/companies/robots.txt
>
> Just exclude the specific path:
>
> RewriteCond $1 !=robots.txt
> RewriteRule ^/(.*) http://localhost:12080/companies/$1 [P]
>
> Bob
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>   "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message