flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raymond Ng <raymond...@gmail.com>
Subject ChannelException: Cannot acquire capacity
Date Wed, 19 Sep 2012 08:19:13 GMT
Hi all

I'm getting the following exception and as I result I lost records even
using File channel
root@test:~/flume-ng/deployment/script$ org.apache.flume.ChannelException:
Unable to put batch on required channel: FileChannel probeFileChannel2 {
dataDirs: [/home/local/flume-ng/filechannel2/data] }
 at
org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:195)
 at test.source.KafkaSource$PartitionManager.next(KafkaSource.java:360)
 at test.source.KafkaSource.process(KafkaSource.java:228)
 at
org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:137)
 at java.lang.Thread.run(Thread.java:679)
Caused by: org.apache.flume.ChannelException: Cannot acquire capacity.
[channel=probeFileChannel2]
 at
org.apache.flume.channel.file.FileChannel$FileBackedTransaction.doPut(FileChannel.java:343)
 at
org.apache.flume.channel.BasicTransactionSemantics.put(BasicTransactionSemantics.java:93)
 at
org.apache.flume.channel.BasicChannelSemantics.put(BasicChannelSemantics.java:76)
 at
org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:184)
 ... 4 more

my file channel config below

agent.channels.probeFileChannel2.type = FILE
agent.channels.probeFileChannel2.checkpointDir =
/home/local/flume-ng/filechannel2/checkpoint
agent.channels.probeFileChannel2.dataDirs =
/home/local/flume-ng/filechannel2/data
agent.channels.probeFileChannel2.transactionCapacity = 200000
agent.channels.probeFileChannel2.checkpointInterval = 10
agent.channels.probeFileChannel2.maxFileSize = 1073741824
agent.channels.probeFileChannel2.capacity = 1000000
agent.channels.probeFileChannel2.keep-alive = 3
agent.channels.probeFileChannel2.write-timeout = 3

advice appreciated
-- 
Rgds
Ray

Mime
View raw message