flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: FlinkKafkaConsumer010 - Memory Issue
Date Wed, 26 Jul 2017 13:14:07 GMT
Hi Pedro!

Can you make a heap dump after a few re-submissions and share a screenshot
or so showing which memory piles up? Is it the buffer memory from the Kafka
Producer or Consumer?

Stephan


On Wed, Jul 26, 2017 at 8:11 AM, Kien Truong <duckientruong@gmail.com>
wrote:

> Hi Pedro,
>
> As long as there's no OutOfMemoryError/long garbage collection pause,
>
> there's nothing to worry about keeping memory allocated.
>
> The memory should be garbage-collected by the JVM when necessary.
>
> Regards,
>
> Kien
>
>
>
> On 7/25/2017 10:53 PM, PedroMrChaves wrote:
>
>> Hello,
>>
>> Thank you for the reply.
>>
>> The problem is not that the task manager uses a lot of memory, the problem
>> is that every time I cancel and re-submit the Job the task manager does
>> not
>> release the previously allocated memory.
>>
>> Regards,
>> Pedro Chaves.
>>
>>
>>
>> -----
>> Best Regards,
>> Pedro Chaves
>> --
>> View this message in context: http://apache-flink-user-maili
>> ng-list-archive.2336050.n4.nabble.com/FlinkKafkaConsumer0
>> 10-Memory-Issue-tp14342p14445.html
>> Sent from the Apache Flink User Mailing List archive. mailing list
>> archive at Nabble.com.
>>
>
>

Mime
View raw message