Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CFAFA10F12 for ; Mon, 20 Jan 2014 02:59:51 +0000 (UTC) Received: (qmail 59118 invoked by uid 500); 20 Jan 2014 02:59:48 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 58989 invoked by uid 500); 20 Jan 2014 02:59:47 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 58981 invoked by uid 99); 20 Jan 2014 02:59:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Jan 2014 02:59:47 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ruralhunter@gmail.com designates 209.85.192.178 as permitted sender) Received: from [209.85.192.178] (HELO mail-pd0-f178.google.com) (209.85.192.178) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Jan 2014 02:59:39 +0000 Received: by mail-pd0-f178.google.com with SMTP id y13so6270243pdi.37 for ; Sun, 19 Jan 2014 18:59:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=TUfFip+2fQXwQHQ2VKEr+6wIBkNNGl03+a2C7s+GQaQ=; b=eRt20xn7gemmKKzURQ3tyAPes/aW4sbXhLO7K5Nd8Eaczvmt2a5kMg9+Y2bAzLmtSy 3vqV0ttsK3BSNMgYbAJiUnh7ubWrmZS11hXwzD031wiBXlXxn65kzXbJ6zFdTk5mcAQy NtyHL3vkDSfkjLyejJ/gzI1dJ0Qhb7fCAttAu2ucylKL1WUqwe8L1NRrVThfDjUTrRFG KjrYTm7ufoFDJNRrT7Bnyi1+8dVxZLmbObh4bCTM8yFAlbp03ZE67Nif4ab1DKQD9fRv MppZKOvCPgZ9Q+PkAyYEVmJee1T6Tbo1WjduacTsRvBpzxapTjoq50/DsIffc2BQgnEo gSGg== X-Received: by 10.66.146.229 with SMTP id tf5mr16213939pab.50.1390186758314; Sun, 19 Jan 2014 18:59:18 -0800 (PST) Received: from [192.168.2.105] ([116.226.73.253]) by mx.google.com with ESMTPSA id de3sm26927858pbb.33.2014.01.19.18.59.15 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sun, 19 Jan 2014 18:59:17 -0800 (PST) Message-ID: <52DC9101.1020605@gmail.com> Date: Mon, 20 Jan 2014 10:59:13 +0800 From: Rural Hunter User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: user@hbase.apache.org Subject: Long running client got NoServerForRegionException Content-Type: text/plain; charset=GB18030; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Hi, I'm using hbase 0.96.1 with hadoop2. I have a client running all the time. It connects to hbase when it receives data from time to time. The logic of this client is like this: 1. It keeps the HConnection got from HConnectionManager.createConnection() when the client inits. 2. It calls getTable from the HConnection kept above to access hbase tables from time to time. There are serveral same clients running on several server. From one time point, On only one of the server, the client started to experience the NoServerForRegionException: org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for after 3 tries. at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1127) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1047) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1004) at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:325) at org.apache.hadoop.hbase.client.HTable.(HTable.java:309) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getTable(HConnectionManager.java:706) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getTable(HConnectionManager.java:688) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getTable(HConnectionManager.java:678) Note the table name and rowkey after 'Unable to find region for' is empty. I checked the code in the client and it can never pass an empty table name to getTable. I also checked the master and zookeeper log but didn't find any error related to this. As far as I know, there could be some intermittent network problem between the client and the hbase server. What can be the cause for the error and how can I avoid/fix it?