Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3F4AB105C4 for ; Mon, 4 Nov 2013 10:11:43 +0000 (UTC) Received: (qmail 26340 invoked by uid 500); 4 Nov 2013 10:11:40 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 26289 invoked by uid 500); 4 Nov 2013 10:11:40 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 26220 invoked by uid 99); 4 Nov 2013 10:11:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 10:11:40 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dcarol@blitzbs.com designates 209.85.214.41 as permitted sender) Received: from [209.85.214.41] (HELO mail-bk0-f41.google.com) (209.85.214.41) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 10:11:32 +0000 Received: by mail-bk0-f41.google.com with SMTP id na10so2853545bkb.28 for ; Mon, 04 Nov 2013 02:11:12 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:organization:user-agent :mime-version:to:subject:content-type; bh=rQUIZAXotZuGQ1ubgtSClpdFo+Y82V1sFCluiDAtcPQ=; b=N8GbvtmPS8z/v7E0T7pquPHPmZ4PV9OoO4lgEcRWSyPUOlr27f2qu1RuGkFiH4SNuV MZpsi7RA+HWL4CmwJQ3jhfIH1jmxtCP8fAM8T8v2RpyFR7qWg+oU7pqwbijjj2BZEYJB hTcEwzsqiccu2cBO0f3TpYNl6y6E8RL0xvKa1AaNCuSLJq86JW0d/nyxepdCZNTv4EiG kl6awp2h054Ye0LMS0B2qM2RASVodmaXDoZTBkJRJRdqqZMdIHNh8J4sq8vj89zCxT9R 4fZqstCew+S3fMgBbIcHqqSEAC2pXb5zykXzpYXgf1P/D67BSB9COYwhwcfNH0CCZvqq 2LzA== X-Gm-Message-State: ALoCoQk8Af685Xv0N7Ibpqy0YsdyoyQstS+MlUQ8h8oCqM+sT4G/fokdtSIlgpxMCNqTrQVd6E9C X-Received: by 10.204.81.10 with SMTP id v10mr395821bkk.55.1383559872504; Mon, 04 Nov 2013 02:11:12 -0800 (PST) Received: from [192.168.7.87] (LNantes-156-76-30-185.w82-127.abo.wanadoo.fr. [82.127.126.185]) by mx.google.com with ESMTPSA id on10sm14227277bkb.13.2013.11.04.02.11.10 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 04 Nov 2013 02:11:11 -0800 (PST) Message-ID: <527772BE.2090402@blitzbs.com> Date: Mon, 04 Nov 2013 11:11:10 +0100 From: Damien Carol Organization: BLITZ B.S. User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.1.0 MIME-Version: 1.0 To: "user@hbase.apache.org" Subject: Hbase Web UI not running Content-Type: multipart/alternative; boundary="------------040702000303050101040102" X-Virus-Checked: Checked by ClamAV on apache.org --------------040702000303050101040102 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Hi, HBase users. I'm working with a 2 Nodes HDFS+HBASE cluster in full distributed mode for 2 months with success now (TABLE with more than 1.000.000.000 rows) . Everything works fine, I used also PHOENIX code from Saleforces with success. BUT. When I added a new node. HBase does not work for the third one. 2 Nodes : HDFS 1.2.1 HBase 0.94.12 OS: Ubuntu Server 12.04.3 The new node is on Centos 6.4 (same version and conf files but different OS) The HDFS part works fine (this node is already part of the HDFS cluster) Ganglia monitoring works well with this centos node The pb is very odd. When I start region server and zoo keeper on third node, I can see it : /[hduser@nc-h04 ~]$ jps 13275 HRegionServer 13445 Jps 13383 HQuorumPeer 1499 DataNode/ I checked client ports (zoo keeper port and 60010) and access is ok and daemon is running. BUT there are no Web UI for third region server. And one last odd thing: in Web UI of the master I see strange report. The master see the region server but with wrong values for heap : /nc-h04,60020,1383565134348 Mon Nov 04 12:38:54 CET 2013 requestsPerSecond=0, numberOfOnlineRegions=0, usedHeapMB=0, maxHeapMB=0 / I checked logs but the only error I see is that : / 2013-11-04 13:03:54,510 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=1.98 MB, free=239.7 MB, max=241.69 MB, blocks=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0, evictions=0, evicted=0, evictedPerRun=NaN 2013-11-04 13:04:10,789 INFO org.apache.hadoop.hbase.HBaseFileSystem: Create Writer, sleeping 1000 times 6 2013-11-04 13:04:16,790 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultReplication 2013-11-04 13:04:16,790 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultBlockSize/ Anybody had same problem with Centos ? Any advice ? Why the daemon is running but there are no Web UI ???? I'm running out of solution. Must back to Ubuntu Server? CDH works with Centos, doesn't it? Regards, -- Damien CAROL * t�l : +33 (0)4 74 96 88 14 * fax : +33 (0)4 74 96 31 88 * email :dcarol@blitzbs.com BLITZ BUSINESS SERVICE --------------040702000303050101040102 Content-Type: multipart/related; boundary="------------050006090606030001000707" --------------050006090606030001000707 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Hi, HBase users.

I'm working with a 2 Nodes HDFS+HBASE cluster in full distributed mode for 2 months with success now (TABLE with more than 1.000.000.000 rows) .

Everything works fine, I used also PHOENIX code from Saleforces with success.

BUT. When I added a new node. HBase does not work for the third one.

2 Nodes :
HDFS 1.2.1
HBase 0.94.12
OS: Ubuntu Server 12.04.3

The new node is on Centos 6.4 (same version and conf files but different OS)

The HDFS part works fine (this node is already part of the HDFS cluster)
Ganglia monitoring works well with this centos node

The pb is very odd. When I start region server and zoo keeper on third node, I can see it :

[hduser@nc-h04 ~]$ jps
13275 HRegionServer
13445 Jps
13383 HQuorumPeer
1499 DataNode

I checked client ports (zoo keeper port  and 60010) and access is ok and daemon is running.

BUT there are no Web UI for third region server.

And one last odd thing: in Web UI of the master I see strange report.

The master see the region server but with wrong values for heap :

nc-h04,60020,1383565134348    Mon Nov 04 12:38:54 CET 2013    requestsPerSecond=0, numberOfOnlineRegions=0, usedHeapMB=0, maxHeapMB=0

I checked logs but the only error I see is that :

2013-11-04 13:03:54,510 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Stats: total=1.98 MB, free=239.7 MB, max=241.69 MB, blocks=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0, evictions=0, evicted=0, evictedPerRun=NaN
2013-11-04 13:04:10,789 INFO org.apache.hadoop.hbase.HBaseFileSystem: Create Writer, sleeping 1000 times 6
2013-11-04 13:04:16,790 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultReplication
2013-11-04 13:04:16,790 INFO org.apache.hadoop.hbase.util.FSUtils: FileSystem doesn't support getDefaultBlockSize

Anybody had same problem with Centos ? Any advice ? Why the daemon is running but there are no Web UI ????

I'm running out of solution. Must back to Ubuntu Server? CDH works with Centos, doesn't it?

Regards,
--

Damien CAROL

BLITZ BUSINESS SERVICE

--------------050006090606030001000707 Content-Type: image/png; name="gaaifhid.png" Content-Transfer-Encoding: base64 Content-ID: Content-Disposition: inline; filename="gaaifhid.png" iVBORw0KGgoAAAANSUhEUgAAAC8AAAArCAYAAADottG6AAAAGXRFWHRTb2Z0d2FyZQBBZG9i ZSBJbWFnZVJlYWR5ccllPAAAAplJREFUeNrsWD1u2zAUJilbTgK4ddoDRDdwbmD3BNGcJZ6s sT5ABg/Z64zWkmTJ7N7AuYF6gjp7C8hAf9IkEvso04FhUyIjUoKK6gE0DOpR/N6n90ciVEst tfwzgrXfMJyewO8o+U8jhJ9+hvjpR4BpFMJMwEZ0e7GsHvjhtAe/8515GjMjEH5cwgaUzSy4 IUx3DsZ8qS74DSPIwzeEoz/bT0K+bsZG3i9TLPj1Jg/fEXn+laWyNuLmNduTMgKL7r1HceMg S8WFcW2dnn+FcVYp8IkBrUNESVOm5nAjrioFHmGC4tY7Ve0BGHBSHfBMLBvF9htVbdcM+OH0 CMZHI+7TbEPyVMoTfVPMT2B0TLkPtdsqmg64zls98Kt06BoN3mZbVfU462FDkXUVmQtyvsM/ v7PDvrUPxeu3iuvc5QM/nJ5JrGeVcpwY6HtLydcbb/px3DxAlhx8R4f5QeZT32M9irxP8T3G 3gce9Ksvae1puw3JYKurEvGvEt+7fCEkcZ2WFvNEJ88KDWYuwlJrugE3vJdRqbi5A7avCLjH +3l3a37BY+FSsGqUvJ/YWumXSIJRtat0U/qUCeh8ErB/z9inxJIX5dPzozzgZ4Y8fcSN3E3B xFYqVnnBh4YMGAgzFSZhMW6zytsTQ+DTgj8oyufX1dUE+53ywZtkX+z3YZHMm2TfuMjBr9gf G9hrhwB2PVI08+uyruWfvA/abo4d2bLo9uJO/xjoe581oAsNx49LJ8+6ss+wwoKHaZzVgixk XW0Z4ENRxpLcDjD9Y9m1YKME4P2Ug8pIMHfNkgOAvld5eaNgVxmLAhVY7210rSEHPVEF/eJ2 hgpQd6uKBmnHQn4jEGy406yoK3Dz907AOowuqqWWWv4v+SvAAEOE1lCEh8AnAAAAAElFTkSu QmCC --------------050006090606030001000707-- --------------040702000303050101040102--