flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrei <faithlessfri...@gmail.com>
Subject Re: Is it possible to check if there are events in a channel?
Date Tue, 27 Aug 2013 10:22:32 GMT
Hi Juhani,

thanks for your answer. Can you please tell me how can I use JMX to get
fill percentage? I have very poor knowledge of JMX, but as far as I
understand it helps to monitor specific resources used by JVM. So what
resource should I monitor to to get fill percentage?

On Tue, Aug 27, 2013 at 11:24 AM, Juhani Connolly <
juhani_connolly@cyberagent.co.jp> wrote:

> You can get the channel capacity and fill percentage using jmx. You'd need
> to regularly poll the fill percentage.
> On 08/26/2013 08:41 PM, Andrei wrote:
>> Are there any tools to monitor state of a Flume channel and,
>> specifically, determine the moment when there are no more events?
>> To give you some context: I have a batch of events that I want to pass
>> through Flume and eventually get to HDFS via corresponding sink. When all
>> events of the batch are dumped, I want to perform post-processing routine
>> on the entire batch. My assumption is that if channel is empty for a while,
>> all events of the batch are dumped and I can start the routing. But how can
>> I determine if channel is empty?

View raw message