camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claus Ibsen <claus.ib...@gmail.com>
Subject Re: FTP2 Component fails to process multiple files at once
Date Thu, 26 May 2011 00:17:37 GMT
Try setting the nmr to synchronous so the ftp consumer does its on
completion in the same thread context

On Wednesday, May 25, 2011, Laurentiu Trica
<laurentiu.trica@finalfolder.biz> wrote:
> Hello,
>
> I attached the test application so you can run immediately. (download the
> archive from here:
> https://issues.apache.org/jira/secure/attachment/12480407/test-camel-ftp.zip
> )
> It's attached to the created issue:
> https://issues.apache.org/jira/browse/CAMEL-4010
>
> It seems that the problem only appears when using camel-nmr. We use separate
> Service Units to declare Local endpoints and Live endpoints for easier
> deployment.
> When using Camel NMR you can see the problem appears.
> Please install camel-nmr in servicemix before deploying the test
> application.
>
> Please tell me if you can reproduce the problem.
>
> Best regards,
> Laurentiu
>
> On Tue, May 24, 2011 at 7:19 PM, Taariq San <taariql@gmail.com> wrote:
>
>> Hmmm, I tried to simulate it too but didn't manage in the short time, maybe
>> somebody who knows the component well figures it out or explains the
>> behavior.
>>
>> The test doesn't need a public server, and you can change the endpoint to
>> anything you like.
>> It just makes it easier to see if there's something in the configuration or
>> to simulate the issue.
>> You can attach it to the ticket you created since it's there already.
>>
>> Taariq
>>
>> On 24 May 2011,  at 5:18 PM, Laurentiu Trica <
>> laurentiu.trica@finalfolder.biz> wrote:
>>
>> > Hello,
>> >
>> > I added a bug on JIRA: https://issues.apache.org/jira/browse/CAMEL-4010
>> >
>> > I think the problem only occurs when the path to FTP includes a folder -
>> > this means your files are not on the root of the FTP account.
>> >
>> > On Tue, May 24, 2011 at 1:32 PM, Laurentiu Trica <
>> > laurentiu.trica@finalfolder.biz> wrote:
>> >
>> >> Hi,
>> >>
>> >> The problem is not that concurrent FTP components are accessing the same
>> >> files.
>> >> The problem is that the one FTP component which handles the files from
>> the
>> >> FTP account is not doing it in separate connections.
>> >> And this is a bad thing to do in a very delicate folder based
>> environment
>> >> like a FTP account.
>> >>
>> >> As you can see from the FTP server logs, there is only one FTP consumer
>> >> connection which handles all the files it finds. The problem is that
>> >> handling the files concurrently on a single FTP connection makes the
>> output
>> >> unpredictable.
>> >>
>> >> I can send my test. Where should I put it? What endpoints should I use?
>> Do
>> >> you have a public access ftp account to test it?
>> >>
>> >>
>> >> On Mon, May 23, 2011 at 7:13 PM, Taariq Levack <taariql@gmail.com>
>> wrote:
>> >>
>> >>> Hi
>> >>>
>> >>> I don't know if it's a bug or not, but I would expect it to work.
>> >>> There's an old ticket to make FTP threadsafe[1], but I only see a
>> >>> concurrent
>> >>> producer test.
>> >>>
>> >>> Can you post your test?
>> >>>
>> >>> [1]https://issues.apache.org/jira/browse/CAMEL-1641
>> >>>
>> >>>
>> >>> On Mon, May 23, 2011 at 11:12 AM, Laurentiu Trica <
>> >>> laurentiu.trica@finalfolder.biz> wrote:
>> >>>
>> >>>> Hello again,
>> >>>>
>> >>>> Anyone had this issue before? Is it a bug in Camel FTP or it's just
>> the
>> >>> way
>> >>>> it is supposed to work?
>> >>>>
>> >>>> On Fri, May 20, 2011 at 6:00 PM, Laurentiu Trica <
>> >>>> laurentiu.trica@finalfolder.biz> wrote:
>> >>>>
>> >>>>> Hello,
>> >>>>>
>> >>>>> I've been struggling to solve a situation in which a FTP poller
was
>> >>> not
>> >>>>> working from time to time.
>> >>>>> I've got to the point where I think I know what the problem
is.
>> >>>>>
>> >>>>> I'm using Camel 2.6 in servicemix.
>> >>>>>
>> >>>>> *I've put up a test for this:*
>> >>>>> - three FTP file producers at different repeating period of
time:
>> 35s,
>> >>>>> 5min, 1h. Note that when starting servicemix they all put the
first
>> >>> file
>> >>>> at
>

-- 
Claus Ibsen
-----------------
FuseSource
Email: cibsen@fusesource.com
Web: http://fusesource.com
CamelOne 2011: http://fusesource.com/camelone2011/
Twitter: davsclaus, fusenews
Blog: http://davsclaus.blogspot.com/
Author of Camel in Action: http://www.manning.com/ibsen/

Mime
View raw message