camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pontus Ullgren <>
Subject Re: looping http fetches of paginated data
Date Mon, 09 Jul 2012 11:11:45 GMT
Just realised that you did not have the number of pages that you
needed to fetch before hand but wanted to loop based on a condition.
Then loop will not help you.

I would go with creating your own processor that does all the collection.

// Pontus

On Mon, Jul 9, 2012 at 1:07 PM, Pontus Ullgren <> wrote:
> Hello,
> You can use loop ( and storing
> information from each request in the exchange.
> However I personally like to keep my camel routes as simple as
> possible and avoid building logic such as this into the routes.
> So I would recommend you to create your own processor that does all
> the data collection and then enriches the message with the complete
> message.
> // Pontus
> On Sun, Jul 8, 2012 at 3:40 PM, Bob Jolliffe <> wrote:
>> I've got a problem which I can't quite figure out how to solve.  I
>> want to configure a route which fetches xml data (representing health
>> facilities) from a repository using a REST http get, transform the
>> data and load into another system.  Typically triggered from a quartz
>> endpoint running every 24 hours.
>> I have found that this is quite straightforward using quartz, http and
>> xslt components.  But ... the data coming from the repository is
>> paginated so I can't fetch it in a single request.
>> Is there anyway to create a route in camel DSL (xml or java) which
>> makes a series of requests to the http service, incrementing an http
>> parameter eg. Page=xx, until some test condition is true in the xml
>> result eg.  count('/Facilities/Facility')=0
>> Thanks for any pointers.
>> Regards
>> Bob

View raw message