Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ECC679CD6 for ; Sat, 1 Sep 2012 18:54:07 +0000 (UTC) Received: (qmail 72702 invoked by uid 500); 1 Sep 2012 18:54:07 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 72675 invoked by uid 500); 1 Sep 2012 18:54:07 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 72665 invoked by uid 99); 1 Sep 2012 18:54:07 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Sep 2012 18:54:07 +0000 Date: Sun, 2 Sep 2012 05:54:07 +1100 (NCT) From: "Uma Maheswara Rao G (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <1152751905.27373.1346525647697.JavaMail.jiratomcat@arcas> In-Reply-To: <65749437.8524.1346186828346.JavaMail.jiratomcat@arcas> Subject: [jira] [Commented] (HDFS-3862) QJM: don't require a fencer to be configured if shared storage has built-in single-writer semantics MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446777#comment-13446777 ] Uma Maheswara Rao G commented on HDFS-3862: ------------------------------------------- Todd, It seems like reasonable to me. I also filed one JIRA to handle this situation with single writer HDFS-3854. But I thought, we could simply provide a fence method which will fence the writer, that means that we have guaranteed that no other NN can access shared storage and then go for state change. In fact if we are ok with leaving the fence to writer level, that is more good. Currently also simply we have a dummy fence method, which will return true as BK already has fencing. >From above suggestion, adding API in JournalManager, it may require to creating the JournalManager for getting this info in ZKFC right? How about simply adding one config parameter? > QJM: don't require a fencer to be configured if shared storage has built-in single-writer semantics > --------------------------------------------------------------------------------------------------- > > Key: HDFS-3862 > URL: https://issues.apache.org/jira/browse/HDFS-3862 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ha > Affects Versions: QuorumJournalManager (HDFS-3077) > Reporter: Todd Lipcon > > Currently, NN HA requires that the administrator configure a fencing method to ensure that only a single NameNode may write to the shared storage at a time. Some shared edits storage implementations (like QJM) inherently enforce single-writer semantics at the storage level, and thus the user should not be forced to specify one. > We should extend the JournalManager interface so that the HA code can operate without a configured fencer if the JM has such built-in fencing. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira