flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From iain wright <iainw...@gmail.com>
Subject Re: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded }
Date Wed, 26 Jul 2017 18:36:36 GMT
Hi Sri,

Are you using a memory channel? What source/sink? 

Can you please paste/link your obfuscated config

What does the metrics endpoint say in terms of channel size, sinkdrainsuccess etc, for the
period leading up to the OOM?


Sent from my iPhone

> On Jul 26, 2017, at 8:00 AM, Anantharaman, Srinatha (Contractor) <Srinatha_Anantharaman@comcast.com>
> Hi All,
> Though I have mentioned the -Xms and -Xmx  values Flume is consuming all memory and failing
at the end
> I have tried adding above parameters in command line as below
> a.     /usr/hdp/current/flume-server/bin/flume-ng agent -c /etc/flume/conf -f /etc/flume/conf/flumeSolr.conf
-n agent -Dproperty="-Xms1024m -Xmx4048m"
> b.    /usr/hdp/current/flume-server/bin/flume-ng agent -c /etc/flume/conf -f /etc/flume/conf/flumeSolr.conf
-n agent -Xms1024m -Xmx4048m
> And also using flume-env.sh file as below
> export JAVA_OPTS="-Xms2048m -Xmx4048m -Dcom.sun.management.jmxremote -XX:+UseParNewGC
> I am using HDP 2.5  and flume
> Kindly let me know how to resolve this issue
> Regards,
> ~Sri

View raw message