flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eran Kutner <e...@gigya.com>
Subject Re: HDFS sink leaves .tmp files
Date Mon, 10 Sep 2012 15:16:55 GMT
I have the same problem. I roll every 1 minute so I have tons of those .tmp
files.

-eran



On Mon, Sep 10, 2012 at 6:02 PM, Chris Neal <cwneal@gmail.com> wrote:

> I'm still seeing this consistently every 24 hour period.  Does this sound
> like a configuration issue, an issue with the Exec source, or an issue with
> the HDFS sink?
>
> Thanks!
>
>
> On Wed, Aug 29, 2012 at 9:18 AM, Chris Neal <cwneal@gmail.com> wrote:
>
>> Hi all,
>>
>> I have an Exec Source running a tail -F on a log4J-generated log file
>> that gets rolled once a day.  It seems that when log4J rolls the file to
>> the new date, the hdfs sink ends up with a .tmp file.  I haven't figured
>> out if there is any data loss yet, but was curious if this is expected
>> behavior?
>>
>> Thanks for your time.
>> Chris
>>
>
>

Mime
View raw message