camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sorin Silaghi <sorin7...@gmail.com>
Subject Re: FTP2 Component fails to process multiple files at once
Date Sun, 11 Sep 2011 14:00:01 GMT
Hi Claus,


                     The workaround you suggested doesn't work. Could you
please increase the priority of this issue ?


thank you,
                    Sorin.


On Thu, May 26, 2011 at 3:17 AM, Claus Ibsen <claus.ibsen@gmail.com> wrote:

> Try setting the nmr to synchronous so the ftp consumer does its on
> completion in the same thread context
>
> On Wednesday, May 25, 2011, Laurentiu Trica
> <laurentiu.trica@finalfolder.biz> wrote:
> > Hello,
> >
> > I attached the test application so you can run immediately. (download the
> > archive from here:
> >
> https://issues.apache.org/jira/secure/attachment/12480407/test-camel-ftp.zip
> > )
> > It's attached to the created issue:
> > https://issues.apache.org/jira/browse/CAMEL-4010
> >
> > It seems that the problem only appears when using camel-nmr. We use
> separate
> > Service Units to declare Local endpoints and Live endpoints for easier
> > deployment.
> > When using Camel NMR you can see the problem appears.
> > Please install camel-nmr in servicemix before deploying the test
> > application.
> >
> > Please tell me if you can reproduce the problem.
> >
> > Best regards,
> > Laurentiu
> >
> > On Tue, May 24, 2011 at 7:19 PM, Taariq San <taariql@gmail.com> wrote:
> >
> >> Hmmm, I tried to simulate it too but didn't manage in the short time,
> maybe
> >> somebody who knows the component well figures it out or explains the
> >> behavior.
> >>
> >> The test doesn't need a public server, and you can change the endpoint
> to
> >> anything you like.
> >> It just makes it easier to see if there's something in the configuration
> or
> >> to simulate the issue.
> >> You can attach it to the ticket you created since it's there already.
> >>
> >> Taariq
> >>
> >> On 24 May 2011,  at 5:18 PM, Laurentiu Trica <
> >> laurentiu.trica@finalfolder.biz> wrote:
> >>
> >> > Hello,
> >> >
> >> > I added a bug on JIRA:
> https://issues.apache.org/jira/browse/CAMEL-4010
> >> >
> >> > I think the problem only occurs when the path to FTP includes a folder
> -
> >> > this means your files are not on the root of the FTP account.
> >> >
> >> > On Tue, May 24, 2011 at 1:32 PM, Laurentiu Trica <
> >> > laurentiu.trica@finalfolder.biz> wrote:
> >> >
> >> >> Hi,
> >> >>
> >> >> The problem is not that concurrent FTP components are accessing the
> same
> >> >> files.
> >> >> The problem is that the one FTP component which handles the files
> from
> >> the
> >> >> FTP account is not doing it in separate connections.
> >> >> And this is a bad thing to do in a very delicate folder based
> >> environment
> >> >> like a FTP account.
> >> >>
> >> >> As you can see from the FTP server logs, there is only one FTP
> consumer
> >> >> connection which handles all the files it finds. The problem is that
> >> >> handling the files concurrently on a single FTP connection makes the
> >> output
> >> >> unpredictable.
> >> >>
> >> >> I can send my test. Where should I put it? What endpoints should I
> use?
> >> Do
> >> >> you have a public access ftp account to test it?
> >> >>
> >> >>
> >> >> On Mon, May 23, 2011 at 7:13 PM, Taariq Levack <taariql@gmail.com>
> >> wrote:
> >> >>
> >> >>> Hi
> >> >>>
> >> >>> I don't know if it's a bug or not, but I would expect it to work.
> >> >>> There's an old ticket to make FTP threadsafe[1], but I only see
a
> >> >>> concurrent
> >> >>> producer test.
> >> >>>
> >> >>> Can you post your test?
> >> >>>
> >> >>> [1]https://issues.apache.org/jira/browse/CAMEL-1641
> >> >>>
> >> >>>
> >> >>> On Mon, May 23, 2011 at 11:12 AM, Laurentiu Trica <
> >> >>> laurentiu.trica@finalfolder.biz> wrote:
> >> >>>
> >> >>>> Hello again,
> >> >>>>
> >> >>>> Anyone had this issue before? Is it a bug in Camel FTP or it's
just
> >> the
> >> >>> way
> >> >>>> it is supposed to work?
> >> >>>>
> >> >>>> On Fri, May 20, 2011 at 6:00 PM, Laurentiu Trica <
> >> >>>> laurentiu.trica@finalfolder.biz> wrote:
> >> >>>>
> >> >>>>> Hello,
> >> >>>>>
> >> >>>>> I've been struggling to solve a situation in which a FTP
poller
> was
> >> >>> not
> >> >>>>> working from time to time.
> >> >>>>> I've got to the point where I think I know what the problem
is.
> >> >>>>>
> >> >>>>> I'm using Camel 2.6 in servicemix.
> >> >>>>>
> >> >>>>> *I've put up a test for this:*
> >> >>>>> - three FTP file producers at different repeating period
of time:
> >> 35s,
> >> >>>>> 5min, 1h. Note that when starting servicemix they all put
the
> first
> >> >>> file
> >> >>>> at
> >
>
> --
> Claus Ibsen
> -----------------
> FuseSource
> Email: cibsen@fusesource.com
> Web: http://fusesource.com
> CamelOne 2011: http://fusesource.com/camelone2011/
> Twitter: davsclaus, fusenews
> Blog: http://davsclaus.blogspot.com/
> Author of Camel in Action: http://www.manning.com/ibsen/
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message