Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4D108D52D for ; Wed, 26 Sep 2012 22:08:21 +0000 (UTC) Received: (qmail 97975 invoked by uid 500); 26 Sep 2012 22:08:16 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 97845 invoked by uid 500); 26 Sep 2012 22:08:16 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 97838 invoked by uid 99); 26 Sep 2012 22:08:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Sep 2012 22:08:16 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.223.176] (HELO mail-ie0-f176.google.com) (209.85.223.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Sep 2012 22:08:09 +0000 Received: by ieak11 with SMTP id k11so3255750iea.35 for ; Wed, 26 Sep 2012 15:07:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=UdV9CZnQfEehOr4WfzZB5wcsbaabk1DjBDLDgrh36Is=; b=lotUo5iBohh4ldrS4yxr7JF8DNlBBzhb4L84er2yd3FQ8+vHwwzKPGvihpfKzRTOYV UOpNV2hXuhSRwKSg1R0T2RfvpLEFGpdtIpcuuPPWnETwI45dYHR88fUw22j9Jz9ZQueK 2A94MJQSbErRWETqSGAQE0IuzkEU+yTUpo4qmclJYetpMFo0ASrspICN753nU0hgCfJa 2OMRFKRCCXO3+oaFQzeZ8U6AmmDoBVEkSnDEWEUtepg0SFR4VSpjjbneDYbdAZHi4MR8 8A5qUYpUzJBDK91Wkc8KlMp3JG88VxjLGWXI/eTKMqCS8MpoQ4jhs+zPRYAZdcbzAbB7 nk9w== Received: by 10.50.77.164 with SMTP id t4mr1864032igw.7.1348697268285; Wed, 26 Sep 2012 15:07:48 -0700 (PDT) MIME-Version: 1.0 Received: by 10.64.13.19 with HTTP; Wed, 26 Sep 2012 15:07:28 -0700 (PDT) In-Reply-To: References: From: Ted Dunning Date: Wed, 26 Sep 2012 15:07:28 -0700 Message-ID: Subject: Re: splitting jobtracker and namenode To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=e89a8f3b9d2f95f0bd04caa20d0d X-Gm-Message-State: ALoCoQmXbiHkh4wn4+xCPJDbZ7ES99vElmYPUIjEcHJi9KwuVge6hVairIKo7Rbdb77//Jf8tqlp --e89a8f3b9d2f95f0bd04caa20d0d Content-Type: text/plain; charset=ISO-8859-1 Why are you changing the TTL on DNS if you aren't moving the name? If you are just changing the config to a new name, then caching won't matter. On Wed, Sep 26, 2012 at 1:46 PM, Patai Sangbutsarakum < silvianhadoop@gmail.com> wrote: > Hi Hadoopers, > > My production Hadoop 0.20.2 cluster has been running Pri. namenode and > Jobtracker together in the same box for long time. it's time to > separate them. I am trying to write up a procedure on this to make > sure that it won't cause any issues. > > - Decrease TTL of DNS entry for value of mapred.job.tracker > - Prepare new name in DNS entry for value of mapred.job.tracker > - Change value of mapred.job.tracker (in mapred-site.xml) to new > server and propagate the new config to whole cluster and clients ( > where Hadoop jobs are submitted from ) > - Create directory defined in mapred.local.dir on new server. > - Make sure that new jobtracker server is not in slave or master file. > - run stop-mapred.sh on current jobtracker server > - run start-mapred.sh on new jobtracker server > > Do I miss anything ? > > Please suggest. > > Patai > --e89a8f3b9d2f95f0bd04caa20d0d Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Why are you changing the TTL on DNS if you aren't moving the name? =A0I= f you are just changing the config to a new name, then caching won't ma= tter.

On Wed, Sep 26, 2012 at 1:46 PM, Pa= tai Sangbutsarakum <silvianhadoop@gmail.com> wrote:
Hi Hadoopers,

My production Hadoop 0.20.2 cluster has been running Pri. namenode and
Jobtracker together in the same box for long time. it's time to
separate them. I am trying to write up a procedure on this to make
sure that it won't cause any issues.

- Decrease TTL of DNS entry for value of mapred.job.tracker
- Prepare new name in DNS entry for value of mapred.job.tracker
- Change value of mapred.job.tracker (in mapred-site.xml) to new
server and propagate the new config to whole cluster and clients (
where Hadoop jobs are submitted from )
- Create directory defined in mapred.local.dir on new server.
- Make sure that new jobtracker server is not in slave or master file.
- run stop-mapred.sh on current jobtracker server
- run start-mapred.sh on new jobtracker server

Do I miss anything ?

Please suggest.

Patai

--e89a8f3b9d2f95f0bd04caa20d0d--