Return-Path: 
 <user-return-11940-apmail-hadoop-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 514CC10888
	for <apmail-hadoop-user-archive@minotaur.apache.org>;
 Thu, 21 Nov 2013 11:50:21 +0000 (UTC)
Received: (qmail 83567 invoked by uid 500); 21 Nov 2013 11:50:10 -0000
Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org
Received: (qmail 83383 invoked by uid 500); 21 Nov 2013 11:50:09 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 83358 invoked by uid 99); 21 Nov 2013 11:50:08 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Nov 2013 11:50:08 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of azuryyyu@gmail.com designates
 209.85.212.47 as permitted sender)
Received: from [209.85.212.47] (HELO mail-vb0-f47.google.com) (209.85.212.47)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Nov 2013 11:50:02 +0000
Received: by mail-vb0-f47.google.com with SMTP id x11so3805370vbb.34
        for <multiple recipients>; Thu, 21 Nov 2013 03:49:41 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :cc:content-type;
        bh=9DjhamrVKzfiroIa/EwkzwIubqtUaJFu7UClL3HCfEc=;
        b=C1mjk50p2PcU6CjX6ZqopBe8hi7rznegGxSnn8PVbHHDSSipg0zVoLnk56f6HWB0gZ
         +KFam5sBeC0FUs+6OTm0EM6HGbh9lJa5GOjmVd3qLNoqkgMYjw7sjZJ6miwo7pmQZVKO
         kbP0K4vznyNXNjMp+xVGKLWy86io45bimBdKvDWNIxvv5fWflkuBWfp7wJSB4fBabG0g
         TJ+7+56anacFP1EF1kugvIEYD7nPCZKr6aemW5yWEvJke+BmjbAI+0r4YEORmX1+oX3T
         PwbWTNLdI/ZazFDu7DukEk1e7Sqr1cuLuESgZfmj6tgZj4QBtW+xml4xw5l8zAYAADRx
         NzyQ==
MIME-Version: 1.0
X-Received: by 10.52.186.228 with SMTP id fn4mr741250vdc.34.1385034581235;
 Thu, 21 Nov 2013 03:49:41 -0800 (PST)
Received: by 10.220.163.201 with HTTP; Thu, 21 Nov 2013 03:49:40 -0800 (PST)
Received: by 10.220.163.201 with HTTP; Thu, 21 Nov 2013 03:49:40 -0800 (PST)
In-Reply-To: <CEB3E9B3.3CFEC%rekha_joshi@intuit.com>
References: 
 <CALr1C9qY+6ZDTw7H1iTkGddSw4ysnZ7RgBx0yM1CE1YEZovt3A@mail.gmail.com>
	<CEB3E9B3.3CFEC%rekha_joshi@intuit.com>
Date: Thu, 21 Nov 2013 19:49:40 +0800
Message-ID: 
 <CALr1C9p-+wMWWc4ec1+vCBHrL=aYAUzgJz=sikZeH7jmc=DfBA@mail.gmail.com>
Subject: Re: HDFS upgrade problem of fsImage
From: Azuryy Yu <azuryyyu@gmail.com>
To: user@hadoop.apache.org
Cc: hdfs-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=bcaec54858f6375c5704ebae7ea6
X-Virus-Checked: Checked by ClamAV on apache.org

--bcaec54858f6375c5704ebae7ea6
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

I insist hot upgrade on the test cluster because I want hot upgrade on the
prod cluster.
 On 2013-11-21 7:23 PM, "Joshi, Rekha" <Rekha_Joshi@intuit.com> wrote:

>  Hi Azurry,
>
> This error occurs when FSImage finds previous fs state, and as log states=
 you would need to either finalizeUpgrade or rollback to proceed.Below -
>
> bin/hadoop dfsadmin =96finalizeUpgrade
> hadoop dfsadmin =96rollback
>
> On side note for a small test cluster on which one might suspect you are =
the only user, why wouldn't you insist on hot upgrade? :-)
>
> Thanks
> Rekha
>
> Some helpful guidelines for upgrade here -
>
> http://wiki.apache.org/hadoop/Hadoop_Upgrade
>
> https://twiki.grid.iu.edu/bin/view/Storage/HadoopUpgrade
>
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Fed=
eration.html#Upgrading_from_older_release_to_0.23_and_configuring_federatio=
n
>
>
>   From: Azuryy Yu <azuryyyu@gmail.com>
> Reply-To: "user@hadoop.apache.org" <user@hadoop.apache.org>
> Date: Thursday 21 November 2013 9:48 AM
> To: "hdfs-dev@hadoop.apache.org" <hdfs-dev@hadoop.apache.org>, "
> user@hadoop.apache.org" <user@hadoop.apache.org>
> Subject: HDFS upgrade problem of fsImage
>
>   Hi Dear,
>
>  I have a small test cluster with hadoop-2.0x, and HA configuraded, but I
> want to upgrade to hadoop-2.2.
>
>  I dont't want to stop cluster during upgrade, so my steps are:
>
>  1)  on standby NN: hadoop-dameon.sh stop namenode
> 2)  remove HA configuration in the conf
> 3)   hadoop-daemon.sh start namenode -upgrade -clusterID test-cluster
>
>  but Exception in the NN log, so how to upgrade and don't stop the whole
> cluster.
> Thanks.
>
>
>  org.apache.hadoop.hdfs.server.common.InconsistentFSStateException:
> Directory /hdfs/name is in an inconsistent state: previous fs state shoul=
d
> not exist during upgrade. Finalize or rollback first.
>         at
> org.apache.hadoop.hdfs.server.namenode.FSImage.doUpgrade(FSImage.java:323=
)
>         at
> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSIm=
age.java:248)
>         at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesys=
tem.java:858)
>         at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesy=
stem.java:620)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.j=
ava:445)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:=
494)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:692)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:677)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.j=
ava:1279)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1345)
>

--bcaec54858f6375c5704ebae7ea6
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">I insist hot upgrade on the test cluster because I want hot =
upgrade on the prod cluster.<br>
</p>
<div class=3D"gmail_quote">On 2013-11-21 7:23 PM, &quot;Joshi, Rekha&quot; =
&lt;<a href=3D"mailto:Rekha_Joshi@intuit.com">Rekha_Joshi@intuit.com</a>&gt=
; wrote:<br type=3D"attribution"><blockquote class=3D"gmail_quote" style=3D=
"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">




<div style=3D"word-wrap:break-word">
<div>
<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
>Hi Azurry,</font></pre>

<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
>This error occurs when FSImage finds previous fs state, and as log states =
you would need to either finalizeUpgrade or rollback to proceed.Below - <br=
>
</font></pre>
<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
>bin/hadoop dfsadmin =96finalizeUpgrade
hadoop dfsadmin =96rollback</font></pre>
<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
>On side note for a small test cluster on which one might suspect you are t=
he only user, why wouldn&#39;t you insist on hot upgrade? :-)</font></pre>

<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
>Thanks
Rekha
<br></font></pre>
<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
>Some helpful guidelines for upgrade here -</font></pre>

<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
><a href=3D"http://wiki.apache.org/hadoop/Hadoop_Upgrade" target=3D"_blank"=
>http://wiki.apache.org/hadoop/Hadoop_Upgrade</a></font></pre>

<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
><a href=3D"https://twiki.grid.iu.edu/bin/view/Storage/HadoopUpgrade" targe=
t=3D"_blank">https://twiki.grid.iu.edu/bin/view/Storage/HadoopUpgrade</a></=
font></pre>

<pre style=3D"line-height:normal;text-indent:0px;letter-spacing:normal;text=
-align:start;font-variant:normal;text-transform:none;font-style:normal;whit=
e-space:pre-wrap;font-weight:normal;word-spacing:0px"><font face=3D"Tahoma"=
><a href=3D"http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoo=
p-hdfs/Federation.html#Upgrading_from_older_release_to_0.23_and_configuring=
_federation" target=3D"_blank">http://hadoop.apache.org/docs/current/hadoop=
-project-dist/hadoop-hdfs/Federation.html#Upgrading_from_older_release_to_0=
.23_and_configuring_federation</a></font></pre>

<pre style=3D"text-indent:0px;letter-spacing:normal;font-variant:normal;tex=
t-align:start;font-style:normal;font-weight:normal;line-height:normal;text-=
transform:none;font-size:medium;white-space:pre-wrap;font-family:Tahoma;wor=
d-spacing:0px">
<font face=3D"Tahoma"><br></font></pre>
</div>
<span style=3D"font-size:13px;font-family:Tahoma,sans-serif">
<div style=3D"border-right:medium none;padding-right:0in;padding-left:0in;p=
adding-top:3pt;text-align:left;font-size:11pt;border-bottom:medium none;fon=
t-family:Calibri;border-top:#b5c4df 1pt solid;padding-bottom:0in;border-lef=
t:medium none">

<span style=3D"font-weight:bold">From: </span>Azuryy Yu &lt;<a href=3D"mail=
to:azuryyyu@gmail.com" target=3D"_blank">azuryyyu@gmail.com</a>&gt;<br>
<span style=3D"font-weight:bold">Reply-To: </span>&quot;<a href=3D"mailto:u=
ser@hadoop.apache.org" target=3D"_blank">user@hadoop.apache.org</a>&quot; &=
lt;<a href=3D"mailto:user@hadoop.apache.org" target=3D"_blank">user@hadoop.=
apache.org</a>&gt;<br>

<span style=3D"font-weight:bold">Date: </span>Thursday 21 November 2013 9:4=
8 AM<br>
<span style=3D"font-weight:bold">To: </span>&quot;<a href=3D"mailto:hdfs-de=
v@hadoop.apache.org" target=3D"_blank">hdfs-dev@hadoop.apache.org</a>&quot;=
 &lt;<a href=3D"mailto:hdfs-dev@hadoop.apache.org" target=3D"_blank">hdfs-d=
ev@hadoop.apache.org</a>&gt;, &quot;<a href=3D"mailto:user@hadoop.apache.or=
g" target=3D"_blank">user@hadoop.apache.org</a>&quot;
 &lt;<a href=3D"mailto:user@hadoop.apache.org" target=3D"_blank">user@hadoo=
p.apache.org</a>&gt;<br>
<span style=3D"font-weight:bold">Subject: </span>HDFS upgrade problem of fs=
Image<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir=3D"ltr">Hi Dear,
<div><br>
</div>
<div>I have a small test cluster with hadoop-2.0x, and HA configuraded, but=
 I want to upgrade to hadoop-2.2.</div>
<div><br>
</div>
<div>I dont&#39;t want to stop cluster during upgrade, so my steps are:</di=
v>
<div><br>
</div>
<div>1) =A0on standby NN: hadoop-dameon.sh stop namenode</div>
<div>2) =A0remove HA configuration in the conf</div>
<div>3) =A0=A0hadoop-daemon.sh start namenode -upgrade -clusterID test-clus=
ter</div>
<div><br>
</div>
<div>but Exception in the NN log, so how to upgrade and don&#39;t stop the =
whole cluster.</div>
<div>Thanks.</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div>org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Dir=
ectory /hdfs/name is in an inconsistent state: previous fs state should not=
 exist during upgrade. Finalize or rollback first.</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSImage.doUp=
grade(FSImage.java:323)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSImage.reco=
verTransitionRead(FSImage.java:248)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem=
.loadFSImage(FSNamesystem.java:858)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem=
.loadFromDisk(FSNamesystem.java:620)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.loa=
dNamesystem(NameNode.java:445)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.ini=
tialize(NameNode.java:494)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.&lt=
;init&gt;(NameNode.java:692)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.&lt=
;init&gt;(NameNode.java:677)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.cre=
ateNameNode(NameNode.java:1279)</div>
<div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.mai=
n(NameNode.java:1345)</div>
</div>
</div>
</div>
</div>
</span>
</div>

</blockquote></div>

--bcaec54858f6375c5704ebae7ea6--