Return-Path: X-Original-To: apmail-incubator-flume-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-flume-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8E3179C6E for ; Wed, 9 May 2012 08:31:52 +0000 (UTC) Received: (qmail 33207 invoked by uid 500); 9 May 2012 08:31:52 -0000 Delivered-To: apmail-incubator-flume-user-archive@incubator.apache.org Received: (qmail 33165 invoked by uid 500); 9 May 2012 08:31:51 -0000 Mailing-List: contact flume-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: flume-user@incubator.apache.org Delivered-To: mailing list flume-user@incubator.apache.org Received: (qmail 33149 invoked by uid 99); 9 May 2012 08:31:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 May 2012 08:31:51 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of lulynn_2008@163.com designates 220.181.13.138 as permitted sender) Received: from [220.181.13.138] (HELO m13-138.163.com) (220.181.13.138) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 May 2012 08:31:41 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=Received:Date:From:To:Subject:Content-Type: MIME-Version:Message-ID; bh=Jtocoas9DKLVLsV7inxeVwNIcQYGjXREAoe1 qm6ae9k=; b=ea44avgRP791Vw49vovAmxKtDd2UgG4mFYiHwtZd6YFvgg+NWZsW 4Bf8ghG6TuJxNbd/EXx2qFNkl5bxe4WQM4wWJelOCtnVXecwWLqKWNFTkGU6BhZo Wo2GG04bV8KD/5u0VAhKfvUTaqvCmHSe6ORWbLj8bpA1R6wCCsqQPhE= Received: from lulynn_2008$163.com ( [202.108.130.138] ) by ajax-webmail-wmsvr138 (Coremail) ; Wed, 9 May 2012 16:31:16 +0800 (CST) X-Originating-IP: [202.108.130.138] Date: Wed, 9 May 2012 16:31:16 +0800 (CST) From: lulynn_2008 To: flume-user@incubator.apache.org Subject: flume-0.9.4: encounter "java.io.IOException: Unexpected exception in loadConfigs" when start flume master X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20120503(18352.4652.4642) Copyright (c) 2002-2012 www.mailtech.cn 163com X-CM-CTRLDATA: jO8/BmZvb3Rlcl9odG09MzM2MDo4MQ== Content-Type: multipart/alternative; boundary="----=_Part_172364_1728105026.1336552276438" MIME-Version: 1.0 Message-ID: <6649da2a.f600.13730b941d6.Coremail.lulynn_2008@163.com> X-CM-TRANSID: isGowEAJUkJUK6pPNRcVAA--.306W X-CM-SenderInfo: poxo50dqbsiiqy6rljoofrz/1tbiWQKps09oqIqLLAAAsj X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== ------=_Part_172364_1728105026.1336552276438 Content-Type: text/plain; charset=GBK Content-Transfer-Encoding: 7bit Hi All, Please help to check why this happened. thank you. -- I am using external zookeeper to run flume. During start flume master node, I got following error information in flumemaster.out. And we can find flume master has been started by pid files. -- But when run "refreshAll" in flume shell, the command failed with "Could not increment version counter...". -- When run flume without external zookeeper, flume can work normally. So I assume this is caused by zookeeper part. Here is the zookeeper configuration: node1 is hostname and node2/node3 is ip. flume.master.zk.servers node1:2181,node2:2181,node3:2181 ERROR INFORMATION: 2012-05-09 01:09:39,418 [main] ERROR master.ConfigManager: ConfigStore init threw IOException java.io.IOException: Unexpected exception in loadConfigs at com.cloudera.flume.master.ZooKeeperConfigStore.loadConfigs(ZooKeeperConfigStore.java:267) at com.cloudera.flume.master.ZooKeeperConfigStore$1.success(ZooKeeperConfigStore.java:138) at com.cloudera.flume.master.ZKClient$1.doTry(ZKClient.java:169) at com.cloudera.util.RetryHarness.attempt(RetryHarness.java:64) at com.cloudera.flume.master.ZKClient.init(ZKClient.java:178) at com.cloudera.flume.master.ZooKeeperConfigStore.connect(ZooKeeperConfigStore.java:145) at com.cloudera.flume.master.ZooKeeperConfigStore.init(ZooKeeperConfigStore.java:110) at com.cloudera.flume.master.ConfigManager.start(ConfigManager.java:375) at com.cloudera.flume.master.flows.FlowConfigManager.start(FlowConfigManager.java:291) at com.cloudera.flume.master.TranslatingConfigurationManager.start(TranslatingConfigurationManager.java:391) at com.cloudera.flume.master.FlumeMaster.serve(FlumeMaster.java:295) at com.cloudera.flume.master.FlumeMaster.main(FlumeMaster.java:556) Caused by: java.io.IOException: Not a data file. at org.apache.avro.file.DataFileStream.initialize(DataFileStream.java:105) at org.apache.avro.file.DataFileStream.(DataFileStream.java:84) at com.cloudera.flume.master.ZooKeeperConfigStore.deserializeConfigs(ZooKeeperConfigStore.java:190) at com.cloudera.flume.master.ZooKeeperConfigStore.loadConfigs(ZooKeeperConfigStore.java:265) ... 11 more ------=_Part_172364_1728105026.1336552276438 Content-Type: text/html; charset=GBK Content-Transfer-Encoding: 7bit
Hi All,
Please help to check why this happened. thank you.
--    I am using external zookeeper to run flume. During start flume master node, I got following error information in flumemaster.out. And we can find flume master has been started by pid files.
--    But when run "refreshAll" in flume shell, the command failed with "Could not increment version counter...".
--    When run flume without external zookeeper, flume can work normally. So I assume this is caused by zookeeper part.
       Here is the zookeeper configuration: node1 is hostname and node2/node3 is ip.
     <property>
    <name>flume.master.zk.servers</name>
    <value>node1:2181,node2:2181,node3:2181</value>
    </property>
    < ;/configuration>

ERROR INFORMATION:
2012-05-09 01:09:39,418 [main] ERROR master.ConfigManager: ConfigStore init threw IOException
java.io.IOException: Unexpected exception in loadConfigs
        at com.cloudera.flume.master.ZooKeeperConfigStore.loadConfigs(ZooKeeperConfigStore.java:267)
        at com.cloudera.flume.master.ZooKeeperConfigStore$1.success(ZooKeeperConfigStore.java:138)
        at com.cloudera.flume.master.ZKClient$1.doTry(ZKClient.java:169)
        at com.cloudera.util.RetryHarness.attempt(RetryHarness.java:64)
        at com.cloudera.flume.master.ZKClient.init(ZKClient.java:178)
        at com.cloudera.flume.master.ZooKeeperConfigStore.connect(ZooKeeperConfigStore.java:145)
        at com.c loudera.flume.master.ZooKeeperConfigStore.init(ZooKeeperConfigStore.java:110)
        at com.cloudera.flume.master.ConfigManager.start(ConfigManager.java:375)
        at com.cloudera.flume.master.flows.FlowConfigManager.start(FlowConfigManager.java:291)
        at com.cloudera.flume.master.TranslatingConfigurationManager.start(TranslatingConfigurationManager.java:391)
        at com.cloudera.flume.master.FlumeMaster.serve(FlumeMaster.java:295)
        at com.cloudera.flume.master.FlumeMaster.main(FlumeMaster.java:556)
Caused by: java.io.IOException: Not a data file.
        at org.apache.avro.file.DataFileStream.initialize(DataFileStream.java:105)
        at org.apache.avro.file.DataFileStream.<init>(DataFileStre am.java:84)
        at com.cloudera.flume.master.ZooKeeperConfigStore.deserializeConfigs(ZooKeeperConfigStore.java:190)
        at com.cloudera.flume.master.ZooKeeperConfigStore.loadConfigs(ZooKeeperConfigStore.java:265)
        ... 11 more



------=_Part_172364_1728105026.1336552276438--