Mailing-List: contact user-help@ambari.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@ambari.apache.org
MIME-Version: 1.0
Date: Thu, 12 Nov 2015 15:48:07 +0700
Message-ID: 
 <CAGD3_Quq3XLqs=95y4zYte4i1hzbFjRRkJY607Y6zp5M=88HYg@mail.gmail.com>
Subject: Flume-agent conf on ambari
From: Zaenal Akhmad Rifai <zaenal@detik.com>
To: user@ambari.apache.org
Content-Type: multipart/alternative; boundary=001a1141bc5c7608f90524540045

--001a1141bc5c7608f90524540045
Content-Type: text/plain; charset=UTF-8

Hello guys, i'm newbie on flume, i want to ask something about
configuration on flume-agent which can write event on HDFS.

for example which i can find on internet is like this.

hdfs-agent.sources= netcat-collect
hdfs-agent.sinks = hdfs-write
hdfs-agent.channels= memory-channel
hdfs-agent.sources.netcat-collect.type = netcat
hdfs-agent.sources.netcat-collect.bind = 127.0.0.1
hdfs-agent.sources.netcat-collect.port = 11111
hdfs-agent.sinks.hdfs-write.type = hdfs
hdfs-agent.sinks.hdfs-write.hdfs.path =/user/user/togatta/
hdfs-agent.sinks.hdfs-write.rollInterval = 10
hdfs-agent.sinks.hdfs-write.hdfs.writeFormat=Text
hdfs-agent.sinks.hdfs-write.hdfs.fileType=DataStream
hdfs-agent.channels.memoryChannel.type = memory
hdfs-agent.channels.memoryChannel.capacity=10000
hdfs-agent.sources.netcat-collect.channels=memoryChannel
hdfs-agent.sinks.hdfs-write.channel=memoryChannel

this configuration will collect about log netcat event, but when i run it,
it cant write on path hdfs which i had to config. So any suggest from all
of you guys?
-- 

Regards,
Zaenal Akhmad Rifai

"May the force be with you"

--001a1141bc5c7608f90524540045
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hello guys, i&#39;m newbie on flume, i want to ask somethi=
ng about configuration on flume-agent which can write event on HDFS.<div><b=
r></div><div>for example which i can find on internet is like this.</div><d=
iv><br></div><div><div>hdfs-agent.sources=3D netcat-collect</div><div>hdfs-=
agent.sinks =3D hdfs-write</div><div>hdfs-agent.channels=3D memory-channel<=
/div><div>hdfs-agent.sources.netcat-collect.type =3D netcat</div><div>hdfs-=
agent.sources.netcat-collect.bind =3D 127.0.0.1</div><div>hdfs-agent.source=
s.netcat-collect.port =3D 11111</div><div>hdfs-agent.sinks.hdfs-write.type =
=3D hdfs</div><div>hdfs-agent.sinks.hdfs-write.hdfs.path =3D/user/user/toga=
tta/</div><div>hdfs-agent.sinks.hdfs-write.rollInterval =3D 10</div><div>hd=
fs-agent.sinks.hdfs-write.hdfs.writeFormat=3DText</div><div>hdfs-agent.sink=
s.hdfs-write.hdfs.fileType=3DDataStream</div><div>hdfs-agent.channels.memor=
yChannel.type =3D memory</div><div>hdfs-agent.channels.memoryChannel.capaci=
ty=3D10000</div><div>hdfs-agent.sources.netcat-collect.channels=3DmemoryCha=
nnel</div><div>hdfs-agent.sinks.hdfs-write.channel=3DmemoryChannel</div><di=
v><br></div><div><div>this configuration will collect about log netcat even=
t, but when i run it, it cant write on path hdfs which i had to config. So =
any suggest from all of you guys?</div>-- <br><div class=3D"gmail_signature=
"><div dir=3D"ltr"><div><div dir=3D"ltr"><br></div><div dir=3D"ltr">Regards=
,<div><span style=3D"font-size:12.8px">Zaenal Akhmad Rifai</span><br></div>=
<div><span style=3D"font-size:12.8px"><br></span></div><div><span style=3D"=
font-size:12.8px">&quot;M</span>ay the force be with you&quot;=C2=A0</div><=
/div></div></div></div>
</div></div></div>

--001a1141bc5c7608f90524540045--