Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DBAFF10C75 for ; Thu, 8 Jan 2015 05:07:04 +0000 (UTC) Received: (qmail 38638 invoked by uid 500); 8 Jan 2015 05:07:01 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 38528 invoked by uid 500); 8 Jan 2015 05:07:01 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 38517 invoked by uid 99); 8 Jan 2015 05:07:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Jan 2015 05:07:00 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.160.177 as permitted sender) Received: from [209.85.160.177] (HELO mail-yk0-f177.google.com) (209.85.160.177) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Jan 2015 05:06:55 +0000 Received: by mail-yk0-f177.google.com with SMTP id 9so378242ykp.8 for ; Wed, 07 Jan 2015 21:05:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=c7pIrspfIYBpNex0UjPWFdAMWCvhshVs0GuokZdAHr4=; b=QX1AdapStTyAlUpGpOh++gfuV3YuTxfrSW0vu/ziuT+NXlMpu1m+APm3GmM185Yb3D fK7W98oKbBD5CYoubmSH0R/DlDUHl25aVRmDsG8CAdMRx7D6nNwXsa5zZtxqgHyrsvIG iz0WNsNBGQkWet58g2b4ivRGQYhI9wfvjuH1R7AotXRK7UUNA0DJxY3+yRyyU08DcJFD NY5FBYcti67CAtYzY3N2puTMT/4ouXzsqASBfr3AJAGhVhRdiselFuZkXMKe+HIwTycd d6aXti1R1rPOnl9xMBO6TZZpMqD8ayJSixiur0Gk0IJvOi/UTJD5DOWd2bAXucjcLuy1 2aOQ== MIME-Version: 1.0 X-Received: by 10.170.93.132 with SMTP id k126mr5632095yka.106.1420693505308; Wed, 07 Jan 2015 21:05:05 -0800 (PST) Received: by 10.170.139.4 with HTTP; Wed, 7 Jan 2015 21:05:05 -0800 (PST) In-Reply-To: References: Date: Wed, 7 Jan 2015 21:05:05 -0800 Message-ID: Subject: Re: HA Hadoop journal nodes configuration From: Ted Yu To: "common-user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a113a077ab80129050c1cfb67 X-Virus-Checked: Checked by ClamAV on apache.org --001a113a077ab80129050c1cfb67 Content-Type: text/plain; charset=UTF-8 Please see http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1-latest/bk_system-admin-guide/content/ch_hadoop-ha-3-2.html Look for 'Standby NameNode' Cheers On Wed, Jan 7, 2015 at 8:57 PM, Shashidhar Rao wrote: > Hi, > Thanks it helped me a lot. But I am not seeing any secondary namenode so > my question is is Secondary Namenode required in HA Hadoop cluster > > Thanks > Sd > > On Thu, Jan 8, 2015 at 9:38 AM, Ted Yu wrote: > >> Please take a look at >> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1-latest/bk_system-admin-guide/content/ch_hadoop-ha-3-1.html >> >> Cheers >> >> On Wed, Jan 7, 2015 at 8:00 PM, Shashidhar Rao < >> raoshashidhar123@gmail.com> wrote: >> >>> Hi, >>> >>> I want to setup Hadoop HA with 2 NameNodes and journal nodes. But I am >>> not sure what should be the configuration of journal nodes >>> >>> 1. How many journal nodes I need >>> 2. What should be the machine configuration like RAM, disk size etc >>> >>> This is for a fairly small cluster dealing with 20 Terabytes of data. >>> >>> Thanks >>> Sd >>> >> >> > --001a113a077ab80129050c1cfb67 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

On Wed, Jan 7, 2015 at 8:57 PM, Sh= ashidhar Rao <raoshashidhar123@gmail.com> wrote:
Hi,
Thanks it helped me a lot. But I am not seeing any secondary namenode so = my question is is Secondary Namenode required in HA Hadoop cluster

<= /div>Thanks
Sd

On Thu, Jan 8, 2015= at 9:38 AM, Ted Yu <yuzhihong@gmail.com> wrote:

On Wed, Jan 7, 2= 015 at 8:00 PM, Shashidhar Rao <raoshashidhar123@gmail.com>= ; wrote:
Hi,

I want to setup Hadoop HA with 2 Nam= eNodes and journal nodes. But I am not sure what should be the configuratio= n of journal nodes

1. How many journal nodes I need
2= . What should be the machine configuration like RAM, disk size etc

<= /div>This is for a fairly small cluster dealing with 20 Terabytes of data.<= br>
Thanks
Sd



--001a113a077ab80129050c1cfb67--