Return-Path: X-Original-To: apmail-incubator-chukwa-user-archive@www.apache.org Delivered-To: apmail-incubator-chukwa-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2F67EDEF9 for ; Fri, 17 Aug 2012 04:53:58 +0000 (UTC) Received: (qmail 33991 invoked by uid 500); 17 Aug 2012 04:53:58 -0000 Delivered-To: apmail-incubator-chukwa-user-archive@incubator.apache.org Received: (qmail 33771 invoked by uid 500); 17 Aug 2012 04:53:52 -0000 Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-user@incubator.apache.org Delivered-To: mailing list chukwa-user@incubator.apache.org Received: (qmail 33738 invoked by uid 99); 17 Aug 2012 04:53:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Aug 2012 04:53:51 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of eric818@gmail.com designates 209.85.220.175 as permitted sender) Received: from [209.85.220.175] (HELO mail-vc0-f175.google.com) (209.85.220.175) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Aug 2012 04:53:44 +0000 Received: by vcbfy27 with SMTP id fy27so2938812vcb.6 for ; Thu, 16 Aug 2012 21:53:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=pfCEinQGaDFHVHv3nfNa7ymTL7EqziK5PRQnsjxVsQg=; b=pFqCABr+ZeeG1qg203/ZMNABhJOdUnBmr05VSklu0eUHmjKYJWqKhe0TePS5WOm/Ct a1LV78fytLY0Mrwocmcci6xpCjj9SHWWEqFtgJxZHcyXi6RTpOvLpLxDh2wFGyqY+iCv WUYksbJz0yT1mt4WCIFwJCby/vXRnfUa8codko4m4I2wcAFPgYcVx2x/QV+66CwhS+tE oVompnIixMIdkbSpn1RH2TG9TuAdrH9ONRTo3QWnzzhHNhKDtoRAc5mQ6ZJbR2F8SZng nnVLrG8+jiByxZ0TW7Rch03NkiirnE5FNaccB9vcFF883Oji4o+X2NrNNaDOfwAOtzVO pllw== MIME-Version: 1.0 Received: by 10.52.17.48 with SMTP id l16mr1359472vdd.98.1345179203438; Thu, 16 Aug 2012 21:53:23 -0700 (PDT) Received: by 10.58.234.41 with HTTP; Thu, 16 Aug 2012 21:53:23 -0700 (PDT) In-Reply-To: References: Date: Thu, 16 Aug 2012 21:53:23 -0700 Message-ID: Subject: Re: Connector error From: Eric Yang To: chukwa-user@incubator.apache.org Content-Type: multipart/alternative; boundary=bcaec5040b9494875104c76ef0ce --bcaec5040b9494875104c76ef0ce Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Make sure you have zookeeper host and port defined in hbase-site.xml. The error looks like they are not defined. hbase.zookeeper.property.clientPort 2222 Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. hbase.zookeeper.quorum rs1.example.com,rs2.example.com,rs3.example.com,rs4.example.co= m,rs5.example.com Comma separated list of servers in the ZooKeeper Quorum. For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.co= m". By default this is set to localhost for local and pseudo-distributed = modes of operation. For a fully-distributed setup, this should be set to a = full list of ZooKeeper quorum servers. If HBASE_MANAGES_ZK is set in hbase-env.sh this is the list of servers which we will start/stop ZooKeeper on. On Thu, Aug 16, 2012 at 5:10 AM, dengyule wrote: > Eric: > ** > I understand what you mean=E3=80=82 > jar cf $CHUKWA_HOME/hbase-env.jar $HBASE_CONF_DIR > > pig > -Dpig.additional.jars=3D${HBASE_HOME}/hbase-0.90.4.jar:${HBASE_HOME}/lib/= zookeeper-3.3.2.jar:${PIG_PATH}/pig.jar:${CHUKWA_HOME}/hbase-env.jar > ${CHUKWA_HOME}/script/pig/ClusterSummary.pig > > I also set it. in the single node model. I can run the pig and view > hicc's chart. in cluster model,my hbase and chukwa are running normally. > but always error in pig running: > org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to > connect to ZooKeeper but the connection closes immediately. This could be= a > sign that the server has too many connections (30 is the > default)..................... > I wonder whether you encountered such a situation. thanks. > > best regards > mason > ------------------ Original ------------------ > *From: * "Eric Yang"; > *Date: * Wed, Aug 15, 2012 10:35 PM > *To: * "chukwa-user@incubator.apache.org"; > ** > *Cc: * "chukwa-user"; ** > *Subject: * Re: Connector error > > This is caused by the Hbase configuration is not in the class path of pig > script. I work around this by jar up hbase config directory and pass as > additional jar to pig. > > Sent from my iPhone > > On Aug 15, 2012, at 12:45 AM, "dengyule" wrote: > > Eric: > Thank you for your valuable reply=E3=80=82According to your tips, = now my > collecor can collect data,and my hbase and chukwa also all normal=E3=80= =82but > when i use the pig to run the ClusterSummary.pig . Always occur the > following error message=EF=BC=9A > > org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to co= nnect to ZooKeeper but the connection closes immediately. This could be a s= ign that the server has too many connections (30 is the default). Consider = inspecting your ZK server logs for that error and then make sure you are re= using HBaseConfiguration as often as you can. See HTable's javadoc for more= information. > at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.(ZooKeeperWa= tcher.java:155) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplemen= tation.getZooKeeperWatcher(HConnectionManager.java:1002) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplemen= tation.setupZookeeperTrackers(HConnectionManager.java:304) > at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplemen= tation.(HConnectionManager.java:295) > at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConn= ectionManager.java:157) > at org.apache.hadoop.hbase.client.HTable.(HTable.java:169) > at org.apache.hadoop.hbase.client.HTable.(HTable.java:147) > at org.apache.pig.backend.hadoop.hbase.HBaseStorage..setLocation(HBaseSt= orage.java:438) > > at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInput= Format.mergeSplitSpecificConf(PigInputFormat.java:134) > at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInput= Format.createRecordReader(PigInputFormat.java:112) > at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.(MapTa= sk.java:489) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > > =EF=BC=A9using HBase provided ZooKeeper. this is my hbase-site.= xml file: > > > hbase.rootdir > hdfs://master:9000/hbase > > > hbase.cluster.distributed > true > > > hbase.master.port > 6000 > > > hbase.zookeeper.quorum > master > > > hbase.master.maxclockskew > 360000 > > > hbase.zookeeper.property.maxClientCnxns > 0 > > > Undo edits > Reference to some of tips. say may be host problem .this is > my /etc/hosts file(master and slave are the same ) > 192.168.10.15 master > 192.168.10.47 h1 > 192.168.10.46 h2 > 192.168.10.41 h3 > 192.168.10.68 h4 > 192.168.10.79 h5 > 192.168.10.76 h6 > 192.168.10.86 h7 > Can you tell me how to solve this problem? thanks again. > > > best regards : > mason > > automatically translated by Google > verb can =E5=8F=AF=E4=BB=A5, =E5=8F=AF, =E8=83=BD, =E8=83=BD=E5=A4=9F, = =E4=BC=9A, =E5=A0=AA be able to =E8=83=BD=E5=A4=9F, =E5=8F=AF=E4=BB=A5, =E5= =8F=AF, =E4=BC=9A be capable of =E8=83=BD=E5=A4=9F > adjective able =E8=83=BD=E5=A4=9F, =E8=83=BD, =E8=83=BD=E5=8A=9B, =E6=9C= =89=E8=83=BD=E5=8A=9B, =E4=BC=9A, =E5=B9=B2 > > > ------------------ Original ------------------ > *From: * "Eric Yang"; > *Date: * Tue, Aug 14, 2012 01:51 PM > *To: * "chukwa-user"; ** > *Subject: * Re: Connector error > > Hi Mason, > > Are you using HBase provided ZooKeeper or standalone ZooKeeper? HBase > client in collector is trying to access ZooKeeper at port 21818, and > unable to connect because there is no ZooKeeper running on port 21818. > Standalone ZooKeeper is running at port 2181, and hbase-site.xml may > not have been configured correctly on the class path of collector. > HBASE_CONF_DIR should be defined in chukwa-env.sh for this to work > properly. Hope this helps. > > regards, > Eric > > > ** > --bcaec5040b9494875104c76ef0ce Content-Type: text/html; charset=GB2312 Content-Transfer-Encoding: quoted-printable Make sure you have zookeeper host and port defined in hbase-site.xml.  = ;The error looks like they are not defined.

<property>
      <name>hbase.zookeeper.property.clientPort</name>
      <value>2222</value>
      <description>Property from ZooKeeper's config zoo.cfg.
      The port at which the clients will connect.
      </description>
    </property>
    <property>
      <name>hbase.zookeeper.quorum</name>
      <value>rs1.example.com,<=
a href=3D"http://rs2.example.com">rs2.example.com,rs3.example.com,rs4.ex=
ample.com,rs5.example.com</va=
lue>
      <description>Comma separated list of servers in the ZooKeeper Q=
uorum.
      For example, "host1.mydoma=
in.com,host2.mydomain.com,host3.mydomain.com".
      By default this is set to localhost for local and pseudo-distributed =
modes
      of operation. For a fully-distributed setup, this should be set to a =
full
      list of ZooKeeper quorum servers. If HBASE_MANAGES_ZK is set in hbase=
-env.sh
      this is the list of servers which we will start/stop ZooKeeper on.
      </description>
    </property>

On Thu, Aug 16, 2= 012 at 5:10 AM, dengyule <dengyule@gmail.com> wrote:
Eric:
     I understand what you mean= =A1=A3
        jar cf $CHUKWA_HOME/h= base-env.jar $HBASE_CONF_DIR 
pig -Dpig.additional.jars=3D${HBASE_HOME}/hbase-0.9= 0.4.jar:${HBASE_HOME}/lib/zookeeper-3.3.2.jar:${PIG_PATH}/pig.jar:${CHUKWA_= HOME}/hbase-env.jar ${CHUKWA_HOME}/script/pig/ClusterSummary.pig
    I also set it. in the single node model.= I can run the pig and view hicc's chart. in cluster mod= el,my hbase and chukwa are running normally.  but always error  i= n pig running:
   org.apache.hadoop.hbase.ZooKeeperConnectionExceptio= n: HBase is able to connect to ZooKeeper but the connection closes immediat= ely. This could be a sign that the server has too many connections (30 is t= he default).....................
    I wonder whether you encountered such a= situation.  thanks.
 
best regards
   mason
------------------ Origin= al ------------------
From:  "Eric Yang"<eric818@gmail.com>;
Date:  Wed, Aug 15, 2012 10:35 PM
Cc:  "chukwa-user"<chukwa-user@incubator.apache.or= g>;
Subject:  Re: Connector error

This is caused by the Hbase configuration is not in the class path of = pig script.  I work around this by jar up hbase config directory and p= ass as additional jar to pig.

Sent from my iPhone

On Aug 15, 2012, at 12:45 AM, "dengyule" <dengyule@gmail.com> wro= te:

Eric:
       Thank you for your valuable reply=A1=A3A<= /span>ccording to = your tips, now my collecor can collect data,and my hbase  and chukwa also all n= ormal=A1=A3but when i use the pig to = run the ClusterSummary.pig . Always occur the following error message=A3=BA
org.apache.hadoop.hbase.ZooKeepe= rConnectionException: HBase is able to connect to ZooKeeper but the connect= ion closes immediately. This could be a sign that the server has too many c= onnections (30 is the default). Consider inspecting your ZK server logs for= that error and then make sure you are reusing HBaseConfiguration as often = as you can. See HTable's javadoc for more information.
at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeep= erWatcher.java:155)
at org.apache.hadoop.hbase.client.HConnectionManage= r$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:100= 2)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementa= tion.setupZookeeperTrackers(HConnectionManager.java:304)
at org.apache.= hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init&g= t;(HConnectionManager.java:295)
at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnec= tionManager.java:157)
at org.apache.hadoop.hbase.client.HTable.<init= >(HTable.java:169)
at org.apache.hadoop.hbase.client.HTable.<init= >(HTable.java:147)
at org.apache.pig.backend.hadoop.hbase.HBaseStorage..setLocation(HBa= seStorage.java:438)

at org.apache.pig.backend.ha= doop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(P= igInputFormat.java:134)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFo= rmat.createRecordReader(PigInputFormat.java:112)
at org.apache.hadoop.m= apred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:489)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731)
at = org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.ha= doop.mapred.Child$4.run(Child.java:255)
at java.security.AccessControll= er.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
       =A1=A1=A3=C9using  HBase provided ZooKeeper.  this is&= nbsp; my hbase-site.xml file:
                     = ;  <configuration>
<property>
    <name= >hbase.rootdir</name>
    <value>hdfs://master:= 9000/hbase</value>
</property>
<property>
 =   <name>hbase.cluster.distributed</name>
   <value>true</value>
</property>
<pr= operty>
   <name>hbase.master.port</name>
&n= bsp;  <value>6000</value>
</property>
<prop= erty>
   <name>hbase.zookeeper.quorum</name>    <value>master</value>
</property>
<= property>
  <name>hbase.master.maxclockskew</name>  <value>360000</value>
</property>
 &l= t;property>
   <name>hbase.zookeeper.property.maxClie= ntCnxns</name>
   <value>0</value>
 </property>
<= ;/configuration>
      &n= bsp; Reference to some= of tips. say may be host problem .t= his is my /etc/hosts file(master and slave are the same )
            192.168.10.15      master
    =         192.168.10.47      h1 =
&nb= sp;           192.168.10.46  &= nbsp;   h2
       =     192.168.10.41      h3
    &nbs= p;       192.168.10.68      h4   &= nbsp;         192.168.10.79    &nbs= p; h5
       =     192.168.10.76      h6
    &nbs= p;       192.168.10.86      h7        
Can you tell me how to solve this problem? thanks again.
 

best regards :
   =       mason
automatically translated by Google
=
verb
can =BF=C9=D2=D4, =BF=C9, =C4=DC, =C4=DC=B9=BB, =BB= =E1, =BF=B0
be able to =C4=DC=B9=BB, =BF=C9=D2=D4, =BF=C9, =BB=E1
be capable of =C4=DC=B9=BB
adjective
able =C4=DC=B9=BB, =C4=DC, =C4=DC=C1=A6, =D3=D0=C4= =DC=C1=A6, =BB=E1, =B8=C9

 
------------------ Origin= al ------------------
From:  "Eric Yang"<eric818@gmail.com>;
Date:  Tue, Aug 14, 2012 01:51 PM
To:  "chukwa-user"<chukwa-user@incubator.apache.or= g>;
Subject:  Re: Connector error

Hi Mason,

Are you using HBase provided ZooKeeper or s= tandalone ZooKeeper?  HBase
client in collector is trying to access= ZooKeeper at port 21818, and
unable to connect because there is no ZooK= eeper running on port 21818.
 Standalone ZooKeeper is running at port 2181, and hbase-site.xml may<= br>not have been configured correctly on the class path of collector.
HB= ASE_CONF_DIR should be defined in chukwa-env.sh for this to work
properl= y.  Hope this helps.

regards,
Eric



--bcaec5040b9494875104c76ef0ce--