Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 107D8DEF7 for ; Wed, 19 Sep 2012 08:19:50 +0000 (UTC) Received: (qmail 18375 invoked by uid 500); 19 Sep 2012 08:19:49 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 18109 invoked by uid 500); 19 Sep 2012 08:19:43 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 18070 invoked by uid 99); 19 Sep 2012 08:19:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Sep 2012 08:19:41 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of raymondair@gmail.com designates 209.85.220.179 as permitted sender) Received: from [209.85.220.179] (HELO mail-vc0-f179.google.com) (209.85.220.179) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Sep 2012 08:19:35 +0000 Received: by vcbf13 with SMTP id f13so797811vcb.38 for ; Wed, 19 Sep 2012 01:19:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=BQy47sG7JTlBYDk39cTynsJbsPBxhqk28OkyQg8D8Gk=; b=StuzbMbw02IJHuO2y5oh2TftJiRgDeN57ScIEU8iGI7BQFkxvI6hACnl7ygPAtnXIe JBK5B8ncZS7c3c5QX7TFMBmj1PQt5viGNaAjyQYD45CnXDZdjBhhQ4ne0qeEN7WfVrW7 UCQZ445pRTeCx8bFdw0Lli/z6WPYEIpqcCvnILY2hivZQ7691nXvLTOOZHKJHIV3sxY6 Z8Ta/YhIdEkXamJ+PjiLMTdbKcNL2bDNdtiMYod5gKUTQF4FLeCXLA+OjmpfeeLs5bMT FnpZYhViksX7O0wX8DeQDLqrHcWN+8QswGHI6PPTuE2v3sFgaSdv3LBBG4dH4SjHmbKP 18lw== MIME-Version: 1.0 Received: by 10.52.24.103 with SMTP id t7mr1248535vdf.84.1348042753954; Wed, 19 Sep 2012 01:19:13 -0700 (PDT) Received: by 10.58.79.140 with HTTP; Wed, 19 Sep 2012 01:19:13 -0700 (PDT) Date: Wed, 19 Sep 2012 09:19:13 +0100 Message-ID: Subject: ChannelException: Cannot acquire capacity From: Raymond Ng To: user@flume.apache.org Content-Type: multipart/alternative; boundary=20cf307813307dd44e04ca09a9ad X-Virus-Checked: Checked by ClamAV on apache.org --20cf307813307dd44e04ca09a9ad Content-Type: text/plain; charset=ISO-8859-1 Hi all I'm getting the following exception and as I result I lost records even using File channel root@test:~/flume-ng/deployment/script$ org.apache.flume.ChannelException: Unable to put batch on required channel: FileChannel probeFileChannel2 { dataDirs: [/home/local/flume-ng/filechannel2/data] } at org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:195) at test.source.KafkaSource$PartitionManager.next(KafkaSource.java:360) at test.source.KafkaSource.process(KafkaSource.java:228) at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:137) at java.lang.Thread.run(Thread.java:679) Caused by: org.apache.flume.ChannelException: Cannot acquire capacity. [channel=probeFileChannel2] at org.apache.flume.channel.file.FileChannel$FileBackedTransaction.doPut(FileChannel.java:343) at org.apache.flume.channel.BasicTransactionSemantics.put(BasicTransactionSemantics.java:93) at org.apache.flume.channel.BasicChannelSemantics.put(BasicChannelSemantics.java:76) at org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:184) ... 4 more my file channel config below agent.channels.probeFileChannel2.type = FILE agent.channels.probeFileChannel2.checkpointDir = /home/local/flume-ng/filechannel2/checkpoint agent.channels.probeFileChannel2.dataDirs = /home/local/flume-ng/filechannel2/data agent.channels.probeFileChannel2.transactionCapacity = 200000 agent.channels.probeFileChannel2.checkpointInterval = 10 agent.channels.probeFileChannel2.maxFileSize = 1073741824 agent.channels.probeFileChannel2.capacity = 1000000 agent.channels.probeFileChannel2.keep-alive = 3 agent.channels.probeFileChannel2.write-timeout = 3 advice appreciated -- Rgds Ray --20cf307813307dd44e04ca09a9ad Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi all
=A0
I'm getting the following exception and as I result I lost records= even using File channel
root@test:~= /flume-ng/deployment/script$ org.apache.flume.ChannelException: Unable = to put batch on required channel: FileChannel probeFileChannel2 { dataDirs:= [/home/local/flume-ng/filechannel2/data] }
=A0at org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelPr= ocessor.java:195)
=A0at test.source.KafkaSource$PartitionManager.next(Ka= fkaSource.java:360)
=A0at test.source.KafkaSource.process(KafkaSource.ja= va:228)
=A0at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(Pollab= leSourceRunner.java:137)
=A0at java.lang.Thread.run(Thread.java:679)
= Caused by: org.apache.flume.ChannelException: Cannot acquire capacity. [cha= nnel=3DprobeFileChannel2]
=A0at org.apache.flume.channel.file.FileChannel$FileBackedTransaction.doPut= (FileChannel.java:343)
=A0at org.apache.flume.channel.BasicTransactionSe= mantics.put(BasicTransactionSemantics.java:93)
=A0at org.apache.flume.ch= annel.BasicChannelSemantics.put(BasicChannelSemantics.java:76)
=A0at org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelPr= ocessor.java:184)
=A0... 4 more
=A0
my file channel config below
=A0
agent.channels.probeFileChannel2.type =3D FILE
agent.channels.probe= FileChannel2.checkpointDir =3D /home/local/flume-ng/filechannel2/checkpoint=
agent.channels.probeFileChannel2.dataDirs =3D /home/local/flume-ng/file= channel2/data
agent.channels.probeFileChannel2.transactionCapacity =3D 200000
agent.ch= annels.probeFileChannel2.checkpointInterval =3D 10
agent.channels.probeF= ileChannel2.maxFileSize =3D 1073741824
agent.channels.probeFileChannel2.= capacity =3D 1000000
agent.channels.probeFileChannel2.keep-alive =3D 3
agent.channels.probeFi= leChannel2.write-timeout =3D 3
=A0
advice appreciated
--
Rgds
Ray
--20cf307813307dd44e04ca09a9ad--