flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Connor Woodson <cwoodson....@gmail.com>
Subject Re: writing logs to HDFS
Date Tue, 15 Jan 2013 05:59:58 GMT
Look at the 'roll' properties of the HDFS sink. You can roll by size, time,
events, or you can set those to 0 and only roll by your path.

http://flume.apache.org/FlumeUserGuide.html#hdfs-sink

- Connor


On Mon, Jan 14, 2013 at 9:51 PM, Chhaya Vishwakarma <
Chhaya.Vishwakarma@lntinfotech.com> wrote:

>  Hi,****
>
> ** **
>
> When flume writes logs to HDFS it creates many small files of single log
> file. Can I write logs to HDFS only in file ? ****
>
> ** **
>
> ** **
>
> Regards,****
>
> Chhaya Vishwakarma****
>
> ** **
>
> ** **
>
> ** **
>
> ------------------------------
> The contents of this e-mail and any attachment(s) may contain confidential
> or privileged information for the intended recipient(s). Unintended
> recipients are prohibited from taking action on the basis of information in
> this e-mail and using or disseminating the information, and must notify the
> sender and delete it from their system. L&T Infotech will not accept
> responsibility or liability for the accuracy or completeness of, or the
> presence of any virus or disabling code in this e-mail"
>

Mime
View raw message