httpd-docs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From André Malo>
Subject Re: Auto-docs rewrite
Date Sun, 07 Aug 2005 08:26:04 GMT
* William A. Rowe, Jr. wrote:

> At 04:53 AM 8/6/2005, André Malo wrote:
> >> >I'd consider query?directive not as that easy as it could be. Think
> >> > of the users that type them manually.
> >>
> >> Yes, I'm thinking of manual entry; and i want something that is
> >> clearly distinct from normal filesystem entries, for the sake of
> >> various query, spiders, and caching approaches.
> >
> >HTTP doesn't know about file systems, so I'm wondering why a spider
> > would care. URLs with query string are indexed as any other URL for a
> > long time now.
> You seem to be missing my point; I don't want spiders crawling that
> section, it will be lookup intensive.  If users google they can hit
> the very same information from the normal pages.

There is no section to crawl. The rules respond with redirects to the real 
documents. If someone sets a link to one of these recognized URLs and a 
spider follows it, then the redirect will be followed and nothing else 
happens. Where do you see a crawling problem? From outside view the 
redirects are not related to each other.

s  s^saaaaaoaaaoaaaaooooaaoaaaomaaaa  a  alataa  aaoat  a  a
a maoaa a laoata  a  oia a o  a m a  o  alaoooat aaool aaoaa
matooololaaatoto  aaa o a  o ms;s;\s;s;g;y;s;:;s;y#mailto: #
 \51/\134\137| #;print;# >

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message