Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4863010580 for ; Tue, 14 Jan 2014 11:29:53 +0000 (UTC) Received: (qmail 24247 invoked by uid 500); 14 Jan 2014 11:29:52 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 24203 invoked by uid 500); 14 Jan 2014 11:29:51 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 24190 invoked by uid 99); 14 Jan 2014 11:29:51 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Jan 2014 11:29:51 +0000 Date: Tue, 14 Jan 2014 11:29:51 +0000 (UTC) From: "Liu Shaohui (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-10335) AuthFailedException in zookeeper may block replication forever MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HBASE-10335: -------------------------------- Attachment: HBASE-10335-v2.diff Update for [~xieliang007]'s review. Add isDebugEnabled check for log. > AuthFailedException in zookeeper may block replication forever > -------------------------------------------------------------- > > Key: HBASE-10335 > URL: https://issues.apache.org/jira/browse/HBASE-10335 > Project: HBase > Issue Type: Bug > Components: Replication, security > Affects Versions: 0.94.15, 0.99.0 > Reporter: Liu Shaohui > Assignee: Liu Shaohui > Priority: Blocker > Attachments: HBASE-10335-v1.diff, HBASE-10335-v2.diff > > > ReplicationSource will rechoose sinks when encounted exceptions during skipping edits to the current sink. But if the zookeeper client for peer cluster go to AUTH_FAILED state, the ReplicationSource will always get AuthFailedException. The ReplicationSource does not reconnect the peer, because reconnectPeer only handle ConnectionLossException and SessionExpiredException. As a result, the replication will print log: > {quote} > 2014-01-14,12:07:06,892 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Getting 0 rs from peer cluster # 20 > 2014-01-14,12:07:06,892 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Slave cluster looks down: 20 has 0 region servers > {quote} > and be blocked forever. > I think other places may have same problems for not handling AuthFailedException in zookeeper. eg: HBASE-8675. > [~apurtell] -- This message was sent by Atlassian JIRA (v6.1.5#6160)