Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id F3B0A200C78 for ; Thu, 4 May 2017 08:11:32 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id F23D2160BBA; Thu, 4 May 2017 06:11:32 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 443D2160BB5 for ; Thu, 4 May 2017 08:11:32 +0200 (CEST) Received: (qmail 33595 invoked by uid 500); 4 May 2017 06:11:26 -0000 Mailing-List: contact users-help@camel.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@camel.apache.org Delivered-To: mailing list users@camel.apache.org Received: (qmail 33583 invoked by uid 99); 4 May 2017 06:11:25 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 May 2017 06:11:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 4E1D51883A5 for ; Thu, 4 May 2017 06:11:25 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.486 X-Spam-Level: *** X-Spam-Status: No, score=3.486 tagged_above=-999 required=6.31 tests=[DKIM_ADSP_CUSTOM_MED=0.001, NML_ADSP_CUSTOM_MED=1.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.972, URI_HEX=1.313] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id YGot8s5x3ZIQ for ; Thu, 4 May 2017 06:11:23 +0000 (UTC) Received: from mwork.nabble.com (mwork.nabble.com [162.253.133.43]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 017E25FB48 for ; Thu, 4 May 2017 06:11:22 +0000 (UTC) Received: from static.162.255.23.22.macminivault.com (unknown [162.255.23.22]) by mwork.nabble.com (Postfix) with ESMTP id EED4E3EDD0072 for ; Wed, 3 May 2017 23:11:20 -0700 (MST) Date: Wed, 3 May 2017 23:11:20 -0700 (MST) From: codentravel To: users@camel.apache.org Message-ID: <1493878280971-5798624.post@n5.nabble.com> Subject: Sometimes the data in body is null.. MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit archived-at: Thu, 04 May 2017 06:11:33 -0000 I have the following route strategy- JAVA DSL restConfiguration().component("restlet") .componentProperty("maxQueued", "-1") .componentProperty("persistingConnections", "true") .componentProperty("pipeliningConnections", "true") .host("localhost").port(Constants.ROUTINGPORT).bindingMode(RestBindingMode.off); // ... tell Camel what api to respond to and where to deliver the incoming messages, ... rest("api/v1"). post("/dc"). consumes("application/octet-stream"). route().routeId("DC Inlet"). to("seda:aggregate?waitForTaskToComplete=Never"); // ... aggregate the messages in to batches of 'completionSize', ... from("seda:aggregate"). routeId("Message Aggregation"). setHeader("id", constant("n/a")). aggregate(header("id"), new MessageAggregation()). completionSize(Constants.BATCHSIZE). to("seda:process?waitForTaskToComplete=Never"); // ... enrich the resulting message with meta data ... from("seda:process"). routeId("Data Enricher"). process(new Enricher("1234")). to("seda:server?waitForTaskToComplete=Always"); // ... and put it on messaging bus--asynchronous bus. from("seda:server"). routeId("Messenger"). process(new Messenger(m_communicator)); *in the messageAgregation class,* if (oldExchange == null) { byte[] newData = newExchange.getIn().getBody(byte[].class); newExchange.getIn().setBody(newData, byte[].class); if (newData.length == 0) droppedCounter++; return newExchange; } byte[] oldData = oldExchange.getIn().getBody(byte[].class); byte[] newData = newExchange.getIn().getBody(byte[].class); if (newData.length == 0) { droppedCounter++; logger.error("-----------------Message drop detected -----------------"); } //create new aggregated data byte[] aggregatedData = join(oldData, newData); oldExchange.getIn().setBody(aggregatedData, byte[].class); return oldExchange; *Context Initialization code:* CamelContext context = new DefaultCamelContext(); CamelContextNameStrategy name = new ExplicitCamelContextNameStrategy("DCContext"); context.setNameStrategy(name); context.disableJMX(); context.setAllowUseOriginalMessage(false); context.setStreamCaching(false); context.addRoutes(new DataRoute()); //I FEEL THESE ARE NOT REQUIRED ExecutorServiceManager exec =context.getExecutorServiceManager(); ThreadPoolProfile thread = exec.getDefaultThreadPoolProfile();] thread.setMaxPoolSize(200); thread.setPoolSize(100); thread.setMaxQueueSize(9000); ExecutorServiceManager exec1 =context.getExecutorServiceManager(); ThreadPoolProfile thread1= exec1.getDefaultThreadPoolProfile(); context.start(); I sometimes see message drop detected log whn i keep for a long run (like 50000+ messages in an hour). What can cause this issue ? and how do i debug where is the problem. Also can you suggest if something is wrong with my routing strategy? -- View this message in context: http://camel.465427.n5.nabble.com/Sometimes-the-data-in-body-is-null-tp5798624.html Sent from the Camel - Users mailing list archive at Nabble.com.