Return-Path: X-Original-To: apmail-camel-users-archive@www.apache.org Delivered-To: apmail-camel-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 223EA85C3 for ; Sun, 11 Sep 2011 14:00:30 +0000 (UTC) Received: (qmail 44400 invoked by uid 500); 11 Sep 2011 14:00:29 -0000 Delivered-To: apmail-camel-users-archive@camel.apache.org Received: (qmail 44355 invoked by uid 500); 11 Sep 2011 14:00:28 -0000 Mailing-List: contact users-help@camel.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@camel.apache.org Delivered-To: mailing list users@camel.apache.org Received: (qmail 44347 invoked by uid 99); 11 Sep 2011 14:00:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 11 Sep 2011 14:00:28 +0000 X-ASF-Spam-Status: No, hits=1.6 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sorin7486@gmail.com designates 209.85.212.51 as permitted sender) Received: from [209.85.212.51] (HELO mail-vw0-f51.google.com) (209.85.212.51) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 11 Sep 2011 14:00:22 +0000 Received: by vws20 with SMTP id 20so2369079vws.24 for ; Sun, 11 Sep 2011 07:00:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=JWbZy1LNeH1aIsZRSsAMlRctRMKYqrBH8xlF3U7lGDM=; b=lClJbqCq00Vseaiwx9oo2vz+e6nY0PSk0OcMRD4iETQ0mEBucmzdG6mMl6g7471Iqe x0hu/3tX22p68Tl4VR1UtUoxYR5wW0rcaHCC6zOVN9Gajtfy9tm5G+hzPBSa+V1sSi28 mT5lR7Z8znwHMy6x/URCPzcXdmU7mgi2asZeQ= MIME-Version: 1.0 Received: by 10.52.20.197 with SMTP id p5mr1463242vde.51.1315749601074; Sun, 11 Sep 2011 07:00:01 -0700 (PDT) Received: by 10.52.159.74 with HTTP; Sun, 11 Sep 2011 07:00:01 -0700 (PDT) In-Reply-To: References: <60515693-5565-4C9F-B40C-D5EFF9B68265@gmail.com> Date: Sun, 11 Sep 2011 17:00:01 +0300 Message-ID: Subject: Re: FTP2 Component fails to process multiple files at once From: Sorin Silaghi To: users@camel.apache.org Content-Type: multipart/alternative; boundary=20cf307c9b3495dd8d04acaad34e X-Virus-Checked: Checked by ClamAV on apache.org --20cf307c9b3495dd8d04acaad34e Content-Type: text/plain; charset=ISO-8859-1 Hi Claus, The workaround you suggested doesn't work. Could you please increase the priority of this issue ? thank you, Sorin. On Thu, May 26, 2011 at 3:17 AM, Claus Ibsen wrote: > Try setting the nmr to synchronous so the ftp consumer does its on > completion in the same thread context > > On Wednesday, May 25, 2011, Laurentiu Trica > wrote: > > Hello, > > > > I attached the test application so you can run immediately. (download the > > archive from here: > > > https://issues.apache.org/jira/secure/attachment/12480407/test-camel-ftp.zip > > ) > > It's attached to the created issue: > > https://issues.apache.org/jira/browse/CAMEL-4010 > > > > It seems that the problem only appears when using camel-nmr. We use > separate > > Service Units to declare Local endpoints and Live endpoints for easier > > deployment. > > When using Camel NMR you can see the problem appears. > > Please install camel-nmr in servicemix before deploying the test > > application. > > > > Please tell me if you can reproduce the problem. > > > > Best regards, > > Laurentiu > > > > On Tue, May 24, 2011 at 7:19 PM, Taariq San wrote: > > > >> Hmmm, I tried to simulate it too but didn't manage in the short time, > maybe > >> somebody who knows the component well figures it out or explains the > >> behavior. > >> > >> The test doesn't need a public server, and you can change the endpoint > to > >> anything you like. > >> It just makes it easier to see if there's something in the configuration > or > >> to simulate the issue. > >> You can attach it to the ticket you created since it's there already. > >> > >> Taariq > >> > >> On 24 May 2011, at 5:18 PM, Laurentiu Trica < > >> laurentiu.trica@finalfolder.biz> wrote: > >> > >> > Hello, > >> > > >> > I added a bug on JIRA: > https://issues.apache.org/jira/browse/CAMEL-4010 > >> > > >> > I think the problem only occurs when the path to FTP includes a folder > - > >> > this means your files are not on the root of the FTP account. > >> > > >> > On Tue, May 24, 2011 at 1:32 PM, Laurentiu Trica < > >> > laurentiu.trica@finalfolder.biz> wrote: > >> > > >> >> Hi, > >> >> > >> >> The problem is not that concurrent FTP components are accessing the > same > >> >> files. > >> >> The problem is that the one FTP component which handles the files > from > >> the > >> >> FTP account is not doing it in separate connections. > >> >> And this is a bad thing to do in a very delicate folder based > >> environment > >> >> like a FTP account. > >> >> > >> >> As you can see from the FTP server logs, there is only one FTP > consumer > >> >> connection which handles all the files it finds. The problem is that > >> >> handling the files concurrently on a single FTP connection makes the > >> output > >> >> unpredictable. > >> >> > >> >> I can send my test. Where should I put it? What endpoints should I > use? > >> Do > >> >> you have a public access ftp account to test it? > >> >> > >> >> > >> >> On Mon, May 23, 2011 at 7:13 PM, Taariq Levack > >> wrote: > >> >> > >> >>> Hi > >> >>> > >> >>> I don't know if it's a bug or not, but I would expect it to work. > >> >>> There's an old ticket to make FTP threadsafe[1], but I only see a > >> >>> concurrent > >> >>> producer test. > >> >>> > >> >>> Can you post your test? > >> >>> > >> >>> [1]https://issues.apache.org/jira/browse/CAMEL-1641 > >> >>> > >> >>> > >> >>> On Mon, May 23, 2011 at 11:12 AM, Laurentiu Trica < > >> >>> laurentiu.trica@finalfolder.biz> wrote: > >> >>> > >> >>>> Hello again, > >> >>>> > >> >>>> Anyone had this issue before? Is it a bug in Camel FTP or it's just > >> the > >> >>> way > >> >>>> it is supposed to work? > >> >>>> > >> >>>> On Fri, May 20, 2011 at 6:00 PM, Laurentiu Trica < > >> >>>> laurentiu.trica@finalfolder.biz> wrote: > >> >>>> > >> >>>>> Hello, > >> >>>>> > >> >>>>> I've been struggling to solve a situation in which a FTP poller > was > >> >>> not > >> >>>>> working from time to time. > >> >>>>> I've got to the point where I think I know what the problem is. > >> >>>>> > >> >>>>> I'm using Camel 2.6 in servicemix. > >> >>>>> > >> >>>>> *I've put up a test for this:* > >> >>>>> - three FTP file producers at different repeating period of time: > >> 35s, > >> >>>>> 5min, 1h. Note that when starting servicemix they all put the > first > >> >>> file > >> >>>> at > > > > -- > Claus Ibsen > ----------------- > FuseSource > Email: cibsen@fusesource.com > Web: http://fusesource.com > CamelOne 2011: http://fusesource.com/camelone2011/ > Twitter: davsclaus, fusenews > Blog: http://davsclaus.blogspot.com/ > Author of Camel in Action: http://www.manning.com/ibsen/ > --20cf307c9b3495dd8d04acaad34e--