flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mahendran m <mahendra...@hotmail.com>
Subject Shutdowning HDFS server leads to flume agent shutdown
Date Fri, 07 Nov 2014 09:33:10 GMT
Hi All,   I am new to Apache flume . I have configured using thrift source to send log to HDFS
my Config as below 
# list sources, sinks and channels in the agenta1.sources = r1a1.sinks = k1a1.channels = c1
# avro sink propertiesa1.sources.r1.type = thrifta1.sources.r1.bind = localhosta1.sources.r1.port
= 44444a1.sources.r1.interceptors = i1a1.sources.r1.interceptors.i1.type = DecoderInterceptor.CustomInterceptor$Buildera1.sources.r1.interceptors.i1.referalUrl=referalUrl
a1.sources.r1.interceptors.i1.referalHost=referalHost 
#HDFS sinka1.sinks.k1.type = hdfsa1.sinks.k1.hdfs.fileType = DataStreama1.sinks.k1.hdfs.fileSuffix=
.txta1.sinks.k1.hdfs.rollSize = 1048576a1.sinks.k1.hdfs.rollCount = 0a1.sinks.k1.hdfs.rollInterval
= 0a1.sinks.k1.hdfs.batchSize = 1000a1.sinks.k1.hdfs.minBlockReplicas = 1a1.sinks.k1.hdfs.callTimeout
= 60000a1.sinks.k1.hdfs.path = hdfs://localhost:9000/flumeChannel100/Thrift
# Use a channel which buffers events in memorya1.channels.c1.type = memorya1.channels.c1.capacity
= 10000000a1.channels.c1.transactionCapacity = 1000a1.channels.c1.byteCapacityBufferPercentage
= 10a1.channels.c1.byteCapacity = 5368709120
# define the flowa1.sources.r1.channels = c1a1.sinks.k1.channel = c1
when i stated HDFS, flume service and generated the logs from c# application . my logs are
moved to HDFS everything OK still now. but when stopped HDFS service . flume agent itself
get stopped. Is this default behavior ? . or any wen wrong .
Regards,Mahendran

 		 	   		   		 	   		   		 	   		   		 	   		  
Mime
View raw message