Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1E5251821E for ; Thu, 2 Jul 2015 14:43:07 +0000 (UTC) Received: (qmail 79852 invoked by uid 500); 2 Jul 2015 14:43:06 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 79756 invoked by uid 500); 2 Jul 2015 14:43:06 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 79744 invoked by uid 99); 2 Jul 2015 14:43:06 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jul 2015 14:43:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 8EA331A6568 for ; Thu, 2 Jul 2015 14:43:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.1 X-Spam-Level: X-Spam-Status: No, score=-0.1 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id H8vCHwyL56pp for ; Thu, 2 Jul 2015 14:42:57 +0000 (UTC) Received: from mail-lb0-f172.google.com (mail-lb0-f172.google.com [209.85.217.172]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 45E2E20DB7 for ; Thu, 2 Jul 2015 14:42:57 +0000 (UTC) Received: by lbcpe5 with SMTP id pe5so33389532lbc.2 for ; Thu, 02 Jul 2015 07:42:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=GwOcgIm+2qptsVnkOK/TSokuUPb+mT1/wLizK6PlzOU=; b=p4fnu06DThj5yjFlDNTVUZy9WIvFNd7wdabFU1Exfx/HrFFmXwFlI1WjZqhV7JjwZ6 7qLmbqiZ30lLyrgLGdKv1sISNQodvl28lvj1+H+80Y0XiQSrd5jiSzkBlbykzyX6NgQ2 xiJnMPxQa7zWDAb+gY3Lpmm7EWqoRzh8iEPVmlCnKAGSMo5tdm6nNyms3NkpLiYwinm2 MNgZmG/uyUigbrRRI+7jUe62erjsTCySwc3WuKF1O+tUHSq584XNVBie27pcHHdWwqCv mxgBKqtrNck+3lGz0hxLm760OEOWAgmMC37OhoAfP9XrmobYOzWzATfiSBQgGQnlqaPd g/hQ== X-Received: by 10.112.105.104 with SMTP id gl8mr31164853lbb.81.1435848176575; Thu, 02 Jul 2015 07:42:56 -0700 (PDT) Received: from [192.168.1.4] (195-126-52-95.baltnet.ru. [95.52.126.195]) by mx.google.com with ESMTPSA id w10sm1459924laz.6.2015.07.02.07.42.54 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 02 Jul 2015 07:42:55 -0700 (PDT) Message-ID: <55954DEC.9060200@gmail.com> Date: Thu, 02 Jul 2015 16:42:52 +0200 From: Dmitry Salychev User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: hdfs-dev@hadoop.apache.org Subject: Re: NameNode as a single point of failure References: <5594D81C.5020303@gmail.com> In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Sure, I did. It's actually not what I'm looking for. I don't want to spend time to make dead NN alive by my hands. There should be a solution for NN-SPOF problem. On 07/02/2015 04:36 PM, Vinayakumar B wrote: > Hi.. > Did you look at the HDFS Namenode high availability? > > -Vinay > On Jul 2, 2015 11:50 AM, "Dmitry Salychev" wrote: > >> Hello, HDFS Developers. >> >> I know that NN is a single point of failure of an entire HDFS cluster. If >> it fails, the cluster will be unavailable no matter how many DN there. I >> know that there is an initiative < >> http://www.wandisco.com/system/files/documentation/Meetup-ConsensusReplication.pdf> >> which introduces ConsensusNode (as I can see it looks like distributed NN) >> and related issues (HDFS-6469 < >> https://issues.apache.org/jira/browse/HDFS-6469>, HADOOP-10641 < >> https://issues.apache.org/jira/browse/HADOOP-10641> and HDFS-7007 < >> https://issues.apache.org/jira/browse/HDFS-7007>). So, I'd like to ask. >> >> Has this NN-SPOF problem been solved? If it hasn't, can you show me an >> entry point where I can help to solve it? >> >> Thanks for your time. >> >> >>