flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hari Shreedharan <hshreedha...@cloudera.com>
Subject Re: dynamically change batch size in run time ?
Date Sat, 20 Sep 2014 18:49:45 GMT
You can change batch size though - that is just config based. So you'd have
to reload the configuration.

On Sat, Sep 20, 2014 at 11:49 AM, Hari Shreedharan <
hshreedharan@cloudera.com> wrote:

> File Channel size cannot be changed dynamically - since the the File
> Channel stores a fixed size queue on disk. Changing it means that you'd
> have to delete the checkpoint and that would mean a full replay which will
> take quite a while.
>
> On Sat, Sep 20, 2014 at 8:16 AM, terreyshih <terreyshih@gmail.com> wrote:
>
>> Hi,
>>
>> I know that flume reads/reloads the config file periodically, but does it
>> just check for changes in the data added (for example, new channel) or does
>> it also reload the batch size ?
>>
>> I am doing some performance tuning and would like to know if I can just
>> change the batch size in run time to get some data
>>
>> thx.
>
>
>

Mime
View raw message