Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flume.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAEiCB-=ADTkKK-4vJtqdVwOq1+fLKoT8Mvixp9UnnLgdE-ZqLQ@mail.gmail.com>
References: 
 <CAEiCB-=ADTkKK-4vJtqdVwOq1+fLKoT8Mvixp9UnnLgdE-ZqLQ@mail.gmail.com>
From: Ahmed Vila <avila@devlogic.eu>
Date: Fri, 30 Oct 2015 15:45:36 +0100
Message-ID: 
 <CAH0hrPu+pLexsgPFR2YH=n5Wk-UmCfy28jE7PPJECtvr_bSeMQ@mail.gmail.com>
Subject: Re: Is it possible to role a file by timestamp?
To: user@flume.apache.org
Content-Type: multipart/alternative; boundary=001a1130d288277bee0523537c6e

--001a1130d288277bee0523537c6e
Content-Type: text/plain; charset=UTF-8

Hi Raj,

It's possible... see Flume User Guide on HDFS Sink path configuration
sequences:
https://flume.apache.org/FlumeUserGuide.html#hdfs-sink

hdfs.rollInterval = 0
hdfs.rollSize = 0
hdfs.rollCount = 0
*hdfs.path = *hdfs://namenode/flume/webdata/file-%D


On Fri, Oct 30, 2015 at 3:40 PM, Raj Kumar <rajkumartheone999@gmail.com>
wrote:

> I would like the files to be rolled at midnight. Not by interval but by
> timestamp. Is this possible?
>
> Cheers,
>
> Raj.
>
>


-- 

Best regards,
Ahmed Vila | Senior software developer
DevLogic | Sarajevo | Bosnia and Herzegovina

Office : +387 33 942 123
Mobile: +387 62 139 348

Website: www.devlogic.eu
E-mail   : avila@devlogic.eu
---------------------------------------------------------------------
This e-mail and any attachment is for authorised use by the intended
recipient(s) only. This email contains confidential information. It should
not be copied, disclosed to, retained or used by, any party other than the
intended recipient. Any unauthorised distribution, dissemination or copying
of this E-mail or its attachments, and/or any use of any information
contained in them, is strictly prohibited and may be illegal. If you are
not an intended recipient then please promptly delete this e-mail and any
attachment and all copies and inform the sender directly via email. Any
emails that you send to us may be monitored by systems or persons other
than the named communicant for the purposes of ascertaining whether the
communication complies with the law and company policies.

-- 
---------------------------------------------------------------------
This e-mail and any attachment is for authorised use by the intended 
recipient(s) only. This email contains confidential information. It should 
not be copied, disclosed to, retained or used by, any party other than the 
intended recipient. Any unauthorised distribution, dissemination or copying 
of this E-mail or its attachments, and/or any use of any information 
contained in them, is strictly prohibited and may be illegal. If you are 
not an intended recipient then please promptly delete this e-mail and any 
attachment and all copies and inform the sender directly via email. Any 
emails that you send to us may be monitored by systems or persons other 
than the named communicant for the purposes of ascertaining whether the 
communication complies with the law and company policies.

--001a1130d288277bee0523537c6e
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Raj,<div><br></div><div>It&#39;s possible... see Flume =
User Guide on HDFS Sink path configuration sequences:</div><div><a href=3D"=
https://flume.apache.org/FlumeUserGuide.html#hdfs-sink">https://flume.apach=
e.org/FlumeUserGuide.html#hdfs-sink</a><br></div><div><br></div><div><span =
style=3D"color:rgb(0,0,0);font-family:&#39;Times New Roman&#39;;font-size:1=
6px">hdfs.rollInterval =3D 0</span><br></div><div><span style=3D"color:rgb(=
0,0,0);font-family:&#39;Times New Roman&#39;;font-size:16px">hdfs.rollSize =
=3D 0</span><span style=3D"color:rgb(0,0,0);font-family:&#39;Times New Roma=
n&#39;;font-size:16px"><br></span></div><div><span style=3D"color:rgb(0,0,0=
);font-family:&#39;Times New Roman&#39;;font-size:16px">hdfs.rollCount =3D =
0</span><span style=3D"color:rgb(0,0,0);font-family:&#39;Times New Roman=
9;;font-size:16px"><br></span></div><div><strong style=3D"color:rgb(0,0,0);=
font-family:&#39;Times New Roman&#39;;font-size:16px">hdfs.path =3D=C2=A0</=
strong><span style=3D"color:rgb(0,0,0);font-family:&#39;Times New Roman&#39=
;;font-size:16px">hdfs://namenode/flume/webdata/file-%D</span><span style=
=3D"color:rgb(0,0,0);font-family:&#39;Times New Roman&#39;;font-size:16px">=
<br></span></div><div><br></div><div><br></div></div><div class=3D"gmail_ex=
tra"><br><div class=3D"gmail_quote">On Fri, Oct 30, 2015 at 3:40 PM, Raj Ku=
mar <span dir=3D"ltr">&lt;<a href=3D"mailto:rajkumartheone999@gmail.com" ta=
rget=3D"_blank">rajkumartheone999@gmail.com</a>&gt;</span> wrote:<br><block=
quote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc=
 solid;padding-left:1ex"><div dir=3D"ltr">I would like the files to be roll=
ed at midnight. Not by interval but by timestamp. Is this possible?<div><br=
></div><div>Cheers,</div><div><br></div><div>Raj.</div><div><br></div></div=
>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div class=
=3D"gmail_signature"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><di=
v><p style=3D"color:rgb(80,0,80)"><span style=3D"color:black">Best regards,=
</span></p><div>Ahmed Vila | Senior software developer</div><div>DevLogic |=
 Sarajevo | Bosnia and Herzegovina</div><div><br></div><div>Office :=C2=A0+=
387 33 942 123=C2=A0</div><div>Mobile:=C2=A0+387 62 139 348</div><div><br><=
/div><div>Website:=C2=A0<a href=3D"http://www.devlogic.eu" target=3D"_blank=
">www.devlogic.eu</a>=C2=A0</div><div>E-mail =C2=A0 :=C2=A0<a href=3D"mailt=
o:avila@devlogic.eu" target=3D"_blank">avila@devlogic.eu</a></div></div></d=
iv></div>------------------------------<u></u>-----------------------------=
-<u></u>---------<br>This e-mail and any attachment is for authorised use b=
y the intended recipient(s) only. This email contains confidential informat=
ion. It should not be copied, disclosed to, retained or used by, any party =
other than the intended recipient. Any unauthorised distribution, dissemina=
tion or copying of this E-mail or its attachments, and/or any use of any in=
formation contained in them, is strictly prohibited and may be illegal. If =
you are not an intended recipient then please promptly delete this e-mail a=
nd any attachment and all copies and inform the sender directly via email. =
Any emails that you send to us may be monitored by systems or persons other=
 than the named communicant for the purposes of ascertaining whether the co=
mmunication complies with the law and company policies.<br></div></div>
</div>

<br>
<font size=3D"2">------------------------------<WBR>-----------------------=
-------<WBR>---------<br>This e-mail and any attachment is for authorised u=
se by the intended recipient(s) only. This email contains confidential info=
rmation. It should not be copied, disclosed to, retained or used by, any pa=
rty other than the intended recipient. Any unauthorised distribution, disse=
mination or copying of this E-mail or its attachments, and/or any use of an=
y information contained in them, is strictly prohibited and may be illegal.=
 If you are not an intended recipient then please promptly delete this e-ma=
il and any attachment and all copies and inform the sender directly via ema=
il. Any emails that you send to us may be monitored by systems or persons o=
ther than the named communicant for the purposes of ascertaining whether th=
e communication complies with the law and company policies.</font>
--001a1130d288277bee0523537c6e--