flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zaenal rifai <togatta.f...@gmail.com>
Subject Flume-agent conf on ambari
Date Mon, 16 Nov 2015 07:35:23 GMT
Hello guys, i'm newbie on flume, i want to ask something about
configuration on flume-agent which can write event on HDFS.

for example which i can find on internet is like this.

hdfs-agent.sources= netcat-collect
hdfs-agent.sinks = hdfs-write
hdfs-agent.channels= memory-channel
hdfs-agent.sources.netcat-collect.type = netcat
hdfs-agent.sources.netcat-collect.bind = 127.0.0.1
hdfs-agent.sources.netcat-collect.port = 11111
hdfs-agent.sinks.hdfs-write.type = hdfs
hdfs-agent.sinks.hdfs-write.hdfs.path =/user/user/togatta/
hdfs-agent.sinks.hdfs-write.rollInterval = 10
hdfs-agent.sinks.hdfs-write.hdfs.writeFormat=Text
hdfs-agent.sinks.hdfs-write.hdfs.fileType=DataStream
hdfs-agent.channels.memoryChannel.type = memory
hdfs-agent.channels.memoryChannel.capacity=10000
hdfs-agent.sources.netcat-collect.channels=memoryChannel
hdfs-agent.sinks.hdfs-write.channel=memoryChannel

this configuration will collect about log netcat event, but when i run it,
it cant write on path hdfs which i had to config. So any suggest from all
of you guys?

Mime
View raw message