flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From iain wright <iainw...@gmail.com>
Subject Re: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded }
Date Wed, 26 Jul 2017 18:36:36 GMT
Hi Sri,

Are you using a memory channel? What source/sink? 

Can you please paste/link your obfuscated config

What does the metrics endpoint say in terms of channel size, sinkdrainsuccess etc, for the
period leading up to the OOM?

Best,
Iain

Sent from my iPhone

> On Jul 26, 2017, at 8:00 AM, Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@comcast.com>
wrote:
> 
> Hi All,
>  
> Though I have mentioned the -Xms and -Xmx  values Flume is consuming all memory and failing
at the end
>  
> I have tried adding above parameters in command line as below
>  
> a.     /usr/hdp/current/flume-server/bin/flume-ng agent -c /etc/flume/conf -f /etc/flume/conf/flumeSolr.conf
-n agent -Dproperty="-Xms1024m -Xmx4048m"
> b.    /usr/hdp/current/flume-server/bin/flume-ng agent -c /etc/flume/conf -f /etc/flume/conf/flumeSolr.conf
-n agent -Xms1024m -Xmx4048m
>  
> And also using flume-env.sh file as below
>  
> export JAVA_OPTS="-Xms2048m -Xmx4048m -Dcom.sun.management.jmxremote -XX:+UseParNewGC
-XX:+UseConcMarkSweepGC"
>  
> I am using HDP 2.5  and flume 1.5.2.2.5
>  
> Kindly let me know how to resolve this issue
>  
> Regards,
> ~Sri

Mime
View raw message