flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joey Echeverria <j...@cloudera.com>
Subject Re: Flume, what happen if the batchsize is not enough
Date Wed, 10 Sep 2014 12:48:41 GMT
There isn't an explicit timeout on the HBaseSink, though there is on
the AsyncHBaseSink. For the HBaseSink, it will grab events out of the
channel until it reaches the batch size or the channel is empty. When
the channel is empty, it will commit however many events it already
pulled from the channel even if it's less than the batch size. So,
there is no worry of events getting delayed due to an insufficient
number, but it can mean sending much smaller batches to HBase.



On Wed, Sep 10, 2014 at 5:20 AM, Guillermo Ortiz <konstt2000@gmail.com> wrote:
> Hi,
> I have a question. I'm using an HBaseSink, If I define a batchSize = 1000
> (for example), and it never get 1000, is there a timeout and send the events
> I got?
> Which is that time?

Joey Echeverria

View raw message