Return-Path: 
 <users-return-57134-apmail-camel-users-archive=camel.apache.org@camel.apache.org>
X-Original-To: apmail-camel-users-archive@www.apache.org
Delivered-To: apmail-camel-users-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id ADA8718BC9
	for <apmail-camel-users-archive@www.apache.org>;
 Fri, 18 Sep 2015 06:56:51 +0000 (UTC)
Received: (qmail 20061 invoked by uid 500); 18 Sep 2015 06:56:50 -0000
Delivered-To: apmail-camel-users-archive@camel.apache.org
Received: (qmail 20015 invoked by uid 500); 18 Sep 2015 06:56:50 -0000
Mailing-List: contact users-help@camel.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:users-help@camel.apache.org>
List-Unsubscribe: <mailto:users-unsubscribe@camel.apache.org>
List-Post: <mailto:users@camel.apache.org>
List-Id: <users.camel.apache.org>
Reply-To: users@camel.apache.org
Delivered-To: mailing list users@camel.apache.org
Delivered-To: moderator for users@camel.apache.org
Received: (qmail 83682 invoked by uid 99); 17 Sep 2015 15:30:38 -0000
X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org
X-Spam-Flag: NO
X-Spam-Score: 3.737
X-Spam-Level: ***
X-Spam-Status: No, score=3.737 tagged_above=-999 required=6.31
	tests=[DKIM_ADSP_CUSTOM_MED=0.001, FREEMAIL_ENVFROM_END_DIGIT=0.25,
	NML_ADSP_CUSTOM_MED=1.2, SPF_SOFTFAIL=0.972, URIBL_BLOCKED=0.001,
	URI_HEX=1.313] autolearn=disabled
Date: Thu, 17 Sep 2015 08:30:29 -0700 (MST)
From: ywang9009 <ywang9009@gmail.com>
To: users@camel.apache.org
Message-ID: <1442503829387-5771602.post@n5.nabble.com>
In-Reply-To: 
 <CAGB5yNmG1Yx+PXfkZz5fJ-Y0uwL4i2W+23ZyMpb-VYSV6KLraQ@mail.gmail.com>
References: <1375338444211-5736621.post@n5.nabble.com>
 <CAGB5yNmG1Yx+PXfkZz5fJ-Y0uwL4i2W+23ZyMpb-VYSV6KLraQ@mail.gmail.com>
Subject: Re: Camel Unmarshal throwing heap space exception
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit

Claus, could you elaborate on the splitter/streaming approach? I am running
into the same issue - gzip unmarshaling is done in memory and I am getting
this error when processing a large file:

java.lang.OutOfMemoryError: Java heap space

at java.util.Arrays.copyOf(Arrays.java:2271)[:1.7.0_45]

at
java.io.ByteArrayOutputStream.toByteArray(ByteArrayOutputStream.java:178)[:1.7.0_45]

at
org.apache.camel.impl.GzipDataFormat.unmarshal(GzipDataFormat.java:52)[142:org.apache.camel.camel-core:2.12.0.redhat-610379]

Here is my blueprint:


<camel:from
uri="file://{{cmi.home}}/{{cmi.myworld.data.file.path}}?doneFileName=${file:name}.done"
/>


<camel:choice>

<camel:when>
<camel:simple>${file:name} regex ".*.gz$" </camel:simple>

<camel:unmarshal ref="gzip"/>

<camel:to

uri="file://{{cmi.home}}/{{cmi.myworld.file.path}}?fileName=${file:name.noext}&amp;doneFileName=${file:name}.done"
/>

<camel:log message="********processGzip:gzip file(${file:name})********" />

</camel:when>
<camel:otherwise>

<camel:log message="********processGzip:regular file(${file:name})********"
/>

<camel:to

uri="file://{{cmi.home}}/{{cmi.myworld.file.path}}?doneFileName=${file:name}.done"
/>

</camel:otherwise>

</camel:choice>


</camel:route>

I am using jboss-fuse-6.1.0.redhat-379



Thank you




--
View this message in context: http://camel.465427.n5.nabble.com/Camel-Unmarshal-throwing-heap-space-exception-tp5736621p5771602.html
Sent from the Camel - Users mailing list archive at Nabble.com.