httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pete Jones <Peter.L.Jo...@cern.ch>
Subject [users@httpd] Redirect search robots onto a dedicated cluster machine
Date Tue, 02 Jul 2013 09:39:28 GMT
Hello

We have a small cluster of machines serving a wiki website. Search engine robots are allowed
in to index the website and these create a lot of traffic that can affect the service. I would
like to redirect all http requests from these robots to one of the machines in the cluster.
Any ideas for how to do this ?

Many thanks in advance for any advice

Mime
View raw message