camel-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Claus Ibsen (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CAMEL-3497) Splitter Component: Setting 'streaming="true" parallelProcessing="true"' consumes large amounts > of heap space for big original messages
Date Wed, 05 Jan 2011 15:04:47 GMT

    [ https://issues.apache.org/jira/browse/CAMEL-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977787#action_12977787
] 

Claus Ibsen commented on CAMEL-3497:
------------------------------------

The CompletionService holds a reference to the Future so there is no gain really.

> Splitter Component: Setting 'streaming="true" parallelProcessing="true"' consumes large
amounts > of heap space for big original messages
> -----------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-3497
>                 URL: https://issues.apache.org/jira/browse/CAMEL-3497
>             Project: Camel
>          Issue Type: Bug
>          Components: camel-core
>    Affects Versions: 2.5.0
>            Reporter: Ralf Steppacher
>            Assignee: Claus Ibsen
>
> Setting 'streaming="true" parallelProcessing="true"' consumes large amounts of heap space
for big original messages. E.g. 1024m of heap is not enough to process an 80Mb with 500'000
lines, splitting it line by line.
> The problem seems to be the ArrayList in MulticastProcessor line 224. It contains a Future<Exchange>
object for every token delivered by the java.util.Scanner. The list is only cleared (going
out of scope) after all Future objects have been completed.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message