Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C566C110B1 for ; Thu, 18 Sep 2014 08:51:39 +0000 (UTC) Received: (qmail 15440 invoked by uid 500); 18 Sep 2014 08:51:32 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 15317 invoked by uid 500); 18 Sep 2014 08:51:32 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 15301 invoked by uid 99); 18 Sep 2014 08:51:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Sep 2014 08:51:32 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of skgadalay@gmail.com designates 74.125.82.173 as permitted sender) Received: from [74.125.82.173] (HELO mail-we0-f173.google.com) (74.125.82.173) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Sep 2014 08:51:07 +0000 Received: by mail-we0-f173.google.com with SMTP id t60so536422wes.4 for ; Thu, 18 Sep 2014 01:51:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=QJ+JNbwMGd8r9N2lrOU9wttjRdAkZ3sZZUsJq4lsYAc=; b=vJkCnuqDg0TfRngjVsbtHuJWTxxYFzjE9APH32WjbEeYoY9VFjpe55HXsdK+iqdhxV ZE7ekZiCvk4pghKPFU5zI0Nt8+ahr+sfFq6g9vH4wzXWrz5NVxyt45PlHZc7a5gOc2sy 0cf+kDIKiS9wkk4CFr31EZLlciuzzNw7P+PNGwi7FwZ2tKtzN8m6U0ajT6hp6ntS0MbV CiLlfTD30Ih7SP8QrB39oS5MHbZqfZ/pt+5oQR+TpH/dq/cl8SJrBs3GtRFmIFh1Fe2Y AzlUkRu23TW1IuT86kJ9zXgypi+jNoL/tzv2fGFzS898x77YP5SSpN4AFXHV37kM2Vlf H96w== MIME-Version: 1.0 X-Received: by 10.194.90.233 with SMTP id bz9mr3348070wjb.94.1411030266367; Thu, 18 Sep 2014 01:51:06 -0700 (PDT) Received: by 10.217.99.199 with HTTP; Thu, 18 Sep 2014 01:51:06 -0700 (PDT) In-Reply-To: References: Date: Thu, 18 Sep 2014 14:21:06 +0530 Message-ID: Subject: Re: Failed to rollback from hadoop-2.4.1 to hadoop 2.2.0 From: Susheel Kumar Gadalay To: user@hadoop.apache.org Content-Type: text/plain; charset=UTF-8 X-Virus-Checked: Checked by ClamAV on apache.org You have to upgrade both name node and data node. Better issue start-dfs.sh -upgrade. Check whether current and previous directories are present in both dfs.namenode.name.dir and dfs.datanode.data.dir directory. On 9/18/14, sam liu wrote: > Hi Expert, > > Below are my steps and is it a hadoop bug or did I miss any thing? Thanks! > > Step: > [A] Upgrade > 1. Install Hadoop 2.2.0 cluster > 2. Stop Hadoop services > 3. Replace 2.2.0 binaries with 2.4.1 binaries > 4. Start datanodes: $HADOOP_HOME/sbin/hadoop-daemon.sh start datanode > 5. Start namenode with option upgrade: $HADOOP_HOME/sbin/hadoop-daemon.sh > start namenode -upgrade > 6. Start secondary namenode, tasktracker and jobtracker > > Result: > > Whole upgrade process could be completed successfully. > > [B] Rollback > 1. Stop all hadoop services > 2. Replace 2.4.1 binaries with 2.2.0 binaries > 3. Start datanodes: $HADOOP_HOME/sbin/hadoop-daemon.sh start datanode > 4. Start namenode with option upgrade: $HADOOP_HOME/sbin/hadoop-daemon.sh > start namenode -rollback > > Result: > > Namenode service could be started > Datanodes failed with exception: > Issue: DataNode failed with following exception > 2014-09-17 11:04:51,416 INFO > org.apache.hadoop.hdfs.server.common.Storage: Lock on > /hadoop/hdfs/data/in_use.lock acquired by nodename 817443@shihc071-public > 2014-09-17 11:04:51,418 FATAL > org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for > block pool Block pool BP-977402492-9.181.64.185-1410497086460 (storage id ) > service to hostname/ip:9000 > org.apache.hadoop.hdfs.server.common.IncorrectVersionException: > Unexpected version of storage directory /hadoop/hdfs/data. Reported: -55. > Expecting = -47. > at > org.apache.hadoop.hdfs.server.common.Storage.setLayoutVersion(Storage.java:1082) > at > org.apache.hadoop.hdfs.server.datanode.DataStorage.setFieldsFromProperties(DataStorage.java:302) > at > org.apache.hadoop.hdfs.server.common.Storage.readProperties(Storage.java:921) >