Mailing-List: contact users-help@camel.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@camel.apache.org
Received-SPF: pass (nike.apache.org: domain of sorin7486@gmail.com designates
 209.85.161.45 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <BANLkTim-JPs1NTQpo_AtsBwY0b0-hJ5adg@mail.gmail.com>
References: <BANLkTi=iaMrOxF8H=w_D3DiX_W+j68ONRw@mail.gmail.com>
	<BANLkTimb4yG-FDbgZ6U_rJqTgcoT8Pf30Q@mail.gmail.com>
	<BANLkTinejsRVo87rA2peatc=a2dBLvY=Nw@mail.gmail.com>
	<BANLkTi=y1aqkDnKvAUoLfa06MR_8sGW+mg@mail.gmail.com>
	<BANLkTintAp-0OW6ij2sfXjNhdJDgzZCW7A@mail.gmail.com>
	<60515693-5565-4C9F-B40C-D5EFF9B68265@gmail.com>
	<BANLkTin1do6jWDRRP0WfOpCxDzKADmTyzw@mail.gmail.com>
	<BANLkTinzcqqFVxbnB+y14fzvsmXw0xppXQ@mail.gmail.com>
	<BANLkTim-JPs1NTQpo_AtsBwY0b0-hJ5adg@mail.gmail.com>
Date: Thu, 1 Sep 2011 12:30:14 +0300
Message-ID: 
 <CAGXzonMys2pysOVaWfVeqwo4966eFFC_GCkgsAfOByR1TtzCZA@mail.gmail.com>
Subject: Re: FTP2 Component fails to process multiple files at once
From: Sorin Silaghi <sorin7486@gmail.com>
To: users@camel.apache.org
Content-Type: multipart/alternative; boundary=0015173fefa85ee1bb04abdde4ee

--0015173fefa85ee1bb04abdde4ee
Content-Type: text/plain; charset=ISO-8859-1

Hi all,


              Is there an issue created for this ? I tried it also and it
doesn't work. Should I take this to the ServiceMix mailing list ?


thanks,
               Sorin.

On Thu, May 26, 2011 at 2:23 PM, Laurentiu Trica <
laurentiu.trica@finalfolder.biz> wrote:

> Hi Claus,
>
> I tried what you said with the synchronous=true option but it doesn't seem
> to work either.
> I put that option to all the nmr routes in the test project but it's the
> same result.
> Is there anything I missed?
>
> This is what I modified:
> camel-context.xml from the endpoint
> <camelContext xmlns="http://camel.apache.org/schema/spring"
> id="camelContext">
>        <route>
>            <from uri="ftps://
>
> sftp-test@192.168.0.25:990/in?password=test&amp;passiveMode=true&amp;isImplicit=true&amp;move=.archive&amp;moveFailed=.error&amp;delay=30000
> "
> />
>            <to
> uri="nmr:{http://www.edigrid.de
> }ftptest-endpoint:ORDERS-IN?synchronous=true"
> />
>        </route>
>
>        <route>
>            <from
> uri="nmr:{http://www.edigrid.de
> }ftptest-endpoint:ORDERS-OUT?synchronous=true"
> />
>            <to uri="file://data/OUT" />
>        </route>
>
>    </camelContext>
>
> camel-context.xml from the camel Service Unit
> <camelContext xmlns="http://camel.apache.org/schema/spring"
> id="camelContext">
>
>        <route id="ftp-test">
>            <from
> uri="nmr:{http://www.edigrid.de
> }ftptest-endpoint:ORDERS-IN?synchronous=true"
> />
>
>            <to
> uri="nmr:{http://www.edigrid.de
> }ftptest-endpoint:ORDERS-OUT?synchronous=true"
> />
>        </route>
>
>
>    </camelContext>
>
> Is this ok?
>
> On Thu, May 26, 2011 at 3:17 AM, Claus Ibsen <claus.ibsen@gmail.com>
> wrote:
>
> > Try setting the nmr to synchronous so the ftp consumer does its on
> > completion in the same thread context
> >
> > On Wednesday, May 25, 2011, Laurentiu Trica
> > <laurentiu.trica@finalfolder.biz> wrote:
> > > Hello,
> > >
> > > I attached the test application so you can run immediately. (download
> the
> > > archive from here:
> > >
> >
> https://issues.apache.org/jira/secure/attachment/12480407/test-camel-ftp.zip
> > > )
> > > It's attached to the created issue:
> > > https://issues.apache.org/jira/browse/CAMEL-4010
> > >
> > > It seems that the problem only appears when using camel-nmr. We use
> > separate
> > > Service Units to declare Local endpoints and Live endpoints for easier
> > > deployment.
> > > When using Camel NMR you can see the problem appears.
> > > Please install camel-nmr in servicemix before deploying the test
> > > application.
> > >
> > > Please tell me if you can reproduce the problem.
> > >
> > > Best regards,
> > > Laurentiu
> > >
> > > On Tue, May 24, 2011 at 7:19 PM, Taariq San <taariql@gmail.com> wrote:
> > >
> > >> Hmmm, I tried to simulate it too but didn't manage in the short time,
> > maybe
> > >> somebody who knows the component well figures it out or explains the
> > >> behavior.
> > >>
> > >> The test doesn't need a public server, and you can change the endpoint
> > to
> > >> anything you like.
> > >> It just makes it easier to see if there's something in the
> configuration
> > or
> > >> to simulate the issue.
> > >> You can attach it to the ticket you created since it's there already.
> > >>
> > >> Taariq
> > >>
> > >> On 24 May 2011,  at 5:18 PM, Laurentiu Trica <
> > >> laurentiu.trica@finalfolder.biz> wrote:
> > >>
> > >> > Hello,
> > >> >
> > >> > I added a bug on JIRA:
> > https://issues.apache.org/jira/browse/CAMEL-4010
> > >> >
> > >> > I think the problem only occurs when the path to FTP includes a
> folder
> > -
> > >> > this means your files are not on the root of the FTP account.
> > >> >
> > >> > On Tue, May 24, 2011 at 1:32 PM, Laurentiu Trica <
> > >> > laurentiu.trica@finalfolder.biz> wrote:
> > >> >
> > >> >> Hi,
> > >> >>
> > >> >> The problem is not that concurrent FTP components are accessing the
> > same
> > >> >> files.
> > >> >> The problem is that the one FTP component which handles the files
> > from
> > >> the
> > >> >> FTP account is not doing it in separate connections.
> > >> >> And this is a bad thing to do in a very delicate folder based
> > >> environment
> > >> >> like a FTP account.
> > >> >>
> > >> >> As you can see from the FTP server logs, there is only one FTP
> > consumer
> > >> >> connection which handles all the files it finds. The problem is
> that
> > >> >> handling the files concurrently on a single FTP connection makes
> the
> > >> output
> > >> >> unpredictable.
> > >> >>
> > >> >> I can send my test. Where should I put it? What endpoints should I
> > use?
> > >> Do
> > >> >> you have a public access ftp account to test it?
> > >> >>
> > >> >>
> > >> >> On Mon, May 23, 2011 at 7:13 PM, Taariq Levack <taariql@gmail.com>
> > >> wrote:
> > >> >>
> > >> >>> Hi
> > >> >>>
> > >> >>> I don't know if it's a bug or not, but I would expect it to work.
> > >> >>> There's an old ticket to make FTP threadsafe[1], but I only see a
> > >> >>> concurrent
> > >> >>> producer test.
> > >> >>>
> > >> >>> Can you post your test?
> > >> >>>
> > >> >>> [1]https://issues.apache.org/jira/browse/CAMEL-1641
> > >> >>>
> > >> >>>
> > >> >>> On Mon, May 23, 2011 at 11:12 AM, Laurentiu Trica <
> > >> >>> laurentiu.trica@finalfolder.biz> wrote:
> > >> >>>
> > >> >>>> Hello again,
> > >> >>>>
> > >> >>>> Anyone had this issue before? Is it a bug in Camel FTP or it's
> just
> > >> the
> > >> >>> way
> > >> >>>> it is supposed to work?
> > >> >>>>
> > >> >>>> On Fri, May 20, 2011 at 6:00 PM, Laurentiu Trica <
> > >> >>>> laurentiu.trica@finalfolder.biz> wrote:
> > >> >>>>
> > >> >>>>> Hello,
> > >> >>>>>
> > >> >>>>> I've been struggling to solve a situation in which a FTP poller
> > was
> > >> >>> not
> > >> >>>>> working from time to time.
> > >> >>>>> I've got to the point where I think I know what the problem is.
> > >> >>>>>
> > >> >>>>> I'm using Camel 2.6 in servicemix.
> > >> >>>>>
> > >> >>>>> *I've put up a test for this:*
> > >> >>>>> - three FTP file producers at different repeating period of
> time:
> > >> 35s,
> > >> >>>>> 5min, 1h. Note that when starting servicemix they all put the
> > first
> > >> >>> file
> > >> >>>> at
> > >
> >
> > --
> > Claus Ibsen
> > -----------------
> > FuseSource
> > Email: cibsen@fusesource.com
> > Web: http://fusesource.com
> > CamelOne 2011: http://fusesource.com/camelone2011/
> > Twitter: davsclaus, fusenews
> > Blog: http://davsclaus.blogspot.com/
> > Author of Camel in Action: http://www.manning.com/ibsen/
> >
>
>
>
> --
> Laurentiu Trica
> Software Developer             Mobile: (+40) 722 329318
> S.C MoreDevs S.R.L.          Email: laurentiu.trica@finalfolder.biz
>
> This message can contain privileged or confidential information and it is
> intended only for addressee. Any unauthorized disclosure is strictly
> prohibited.
>

--0015173fefa85ee1bb04abdde4ee--