flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From terreyshih <terreys...@gmail.com>
Subject Re: dynamically change batch size in run time ?
Date Sat, 20 Sep 2014 21:27:38 GMT
thanks.

On Sep 20, 2014, at 11:49 AM, Hari Shreedharan <hshreedharan@cloudera.com> wrote:

> You can change batch size though - that is just config based. So you'd have to reload
the configuration.
> 
> On Sat, Sep 20, 2014 at 11:49 AM, Hari Shreedharan <hshreedharan@cloudera.com>
wrote:
> File Channel size cannot be changed dynamically - since the the File Channel stores a
fixed size queue on disk. Changing it means that you'd have to delete the checkpoint and that
would mean a full replay which will take quite a while.
> 
> On Sat, Sep 20, 2014 at 8:16 AM, terreyshih <terreyshih@gmail.com> wrote:
> Hi,
> 
> I know that flume reads/reloads the config file periodically, but does it just check
for changes in the data added (for example, new channel) or does it also reload the batch
size ?
> 
> I am doing some performance tuning and would like to know if I can just change the batch
size in run time to get some data
> 
> thx.
> 
> 


Mime
View raw message