flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Juhani Connolly <juhani_conno...@cyberagent.co.jp>
Subject Re: Is it possible to check if there are events in a channel?
Date Tue, 27 Aug 2013 08:24:08 GMT
You can get the channel capacity and fill percentage using jmx. You'd 
need to regularly poll the fill percentage.

On 08/26/2013 08:41 PM, Andrei wrote:
> Are there any tools to monitor state of a Flume channel and, 
> specifically, determine the moment when there are no more events?
>
> To give you some context: I have a batch of events that I want to pass 
> through Flume and eventually get to HDFS via corresponding sink. When 
> all events of the batch are dumped, I want to perform post-processing 
> routine on the entire batch. My assumption is that if channel is empty 
> for a while, all events of the batch are dumped and I can start the 
> routing. But how can I determine if channel is empty?


Mime
View raw message