flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean <lagaru...@yahoo.fr>
Subject Re: Better file sink
Date Fri, 26 Sep 2014 18:28:27 GMT
Sounds interesting. I'll test it out.
But what about the parameters like minblockreplicas and the others specific to hdfs ?

> Le 26 sept. 2014 à 16:31, Joey Echeverria <joey@cloudera.com> a écrit :
> 
> The HDFS sink can also write to the local file system. Use a file://
> URL for the hdfs.path.
> 
> -Joey
> 
>> On Fri, Sep 26, 2014 at 6:14 AM, Sharninder <sharninder@gmail.com> wrote:
>> Implementing a new sink isn't that difficult really so if your requirements
>> aren't met with the current file sink, by all means write your own. Take a
>> look at the existing code and the Dev guide.
>> 
>> On 26-Sep-2014, at 5:47 pm, jean garutti <lagarutte@yahoo.fr> wrote:
>> 
>> Hello,
>> For differents purposes, i want to store the events on local files and
>> els/hdfs.
>> I checked the fileRoll sink but it's very limited in fucntionnality.
>> I can't specify a dynamic path, rolling, timeidle like the hdfs sink.
>> 
>> Do you think that it can be easy implemented ?
>> 
>> jean
> 
> 
> 
> -- 
> Joey Echeverria

Mime
View raw message