hc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Becke <be...@u.washington.edu>
Subject Re: robots.txt parser
Date Tue, 02 Nov 2004 02:30:34 GMT
On Nov 1, 2004, at 5:59 PM, Oleg Kalnichevski wrote:

> Can we keep it in the sandbox for a while? As soon as HttpClient 4.0 
> API
> starts shaping up, the robot.txt parser could be migrated to Jakarta
> HttpClient to lay a foundation for a web crawler subcomponent.
>
> Folks, what do you think?

Sounds about right to me.  I'm definitely looking forward to it.

Mike


---------------------------------------------------------------------
To unsubscribe, e-mail: httpclient-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: httpclient-dev-help@jakarta.apache.org


Mime
View raw message