Mailing-List: contact users-help@camel.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@camel.apache.org
From: Quinn Stevenson <quinn@pronoia-solutions.com>
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
Subject: Re: Good / Adviced way to poll an entire folder at scheduled moment
Date: Thu, 11 May 2017 08:14:49 -0600
References: <CA+D-ZCTjRA61J9B_d_h6RXWbpYNw-=ukgdEJN2Pa0fHZUvzYtg@mail.gmail.com>
To: users@camel.apache.org
In-Reply-To: <CA+D-ZCTjRA61J9B_d_h6RXWbpYNw-=ukgdEJN2Pa0fHZUvzYtg@mail.gmail.com>
Message-Id: <DCEF64C4-94B9-41C7-ADE4-5C4122256BCD@pronoia-solutions.com>
archived-at: Thu, 11 May 2017 14:14:49 -0000

I=E2=80=99ve done this with a combination of a ScheduledRoutePolicy (to =
start the route when I want to start reading the directory) and a call =
to the control bus when all the files have been processed.  I use the =
=E2=80=9CsendEmptyMessageWhenIdle=E2=80=9D option on the file component =
to detect when it=E2=80=99s done.

HTH

> On May 8, 2017, at 8:49 AM, Jonathan Schoreels =
<jonathan.schoreels@gmail.com> wrote:
>=20
> Hi.
>=20
> I would like to know, in your experience, what's the best way to poll =
an
> entire folder/remote folder, at an regular interval ?
>=20
> It could seems quite easy, since the the file consumer can be used as =
a
> batch consumer, that a scheduler can be used with it, but I have some
> limitation each time :
>=20
> 1. Batch consumer : How to set a "good maxMessagePerPoll" ? If I =
hardcode
> it, and poll those messages each day, I'm not future proof if more =
file
> comes.
> 2. poll enrich only poll one at a time. So if I need to poll ALL the =
folder
> each day, it doesn't help me.
> 3. having to start/stop routes with controle bus seems lot of
> tweaks/hacking just to design a simple flow.
>=20
> Have you any suggestion ?
>=20
> Jonathan