hc-httpclient-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paul Bear <xpy...@gmail.com>
Subject Re: GETs and Responses in different threads ?
Date Wed, 04 Mar 2015 10:55:39 GMT
Graeme, thanks for the example. I wonder what the number of threads is that
process the responses ? Is it the number of Processors from Runtime class,
is it configurable ?

2015-03-04 11:04 GMT+01:00 Graeme Wallace <graeme.wallace@farecompare.com>:

> Async Http package does what you are looking for.
>
> https://hc.apache.org/httpcomponents-asyncclient-dev/examples.html
>
> 3rd example down is where you want to start.
>
>
> Graeme
>
> On Wed, Mar 4, 2015 at 9:54 AM, Paul Bear <xpyazu@gmail.com> wrote:
>
> > I have a large list of URLs (about 1 millon) and I want to run
> >
> > - one thread that runs through the list and asynchronously sends GET
> > requests
> > - several worker threads that process the responses
> >
> > Is it possible to separate sending GETs and processing responses in
> > different threads using Apache Client ?
> >
> > Any ideas are welcome!
> >
>
>
>
> --
> Graeme Wallace
> CTO
> FareCompare.com
> O: 972 588 1414
> M: 214 681 9018
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message