hc-httpclient-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Douglas Ferguson <doug...@douglasferguson.us>
Subject robots.txt
Date Thu, 25 Feb 2010 16:54:03 GMT
Not sure if this is off topic or not, does anybody have any recommendations on respecting robots.txt
when using HttpClient?

D
---------------------------------------------------------------------
To unsubscribe, e-mail: httpclient-users-unsubscribe@hc.apache.org
For additional commands, e-mail: httpclient-users-help@hc.apache.org


Mime
View raw message