Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E73FDE57B for ; Wed, 30 Jan 2013 16:28:22 +0000 (UTC) Received: (qmail 54999 invoked by uid 500); 30 Jan 2013 16:28:18 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 54884 invoked by uid 500); 30 Jan 2013 16:28:17 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 54877 invoked by uid 99); 30 Jan 2013 16:28:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jan 2013 16:28:17 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.223.172 as permitted sender) Received: from [209.85.223.172] (HELO mail-ie0-f172.google.com) (209.85.223.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jan 2013 16:28:11 +0000 Received: by mail-ie0-f172.google.com with SMTP id c10so1424477ieb.17 for ; Wed, 30 Jan 2013 08:27:50 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:x-gm-message-state; bh=OWy0Nus3W+jsN+a2PF47gF39FvjtJCEeQhisAUGhlDU=; b=Sag04P3Zz+pPCeXejJK0SCE91Kplp08tRcxJMAh/hYCPs+SeXGMHYehUUcc8l7bNBr 78vKBKcC/RW510gB3nM0hUbNcsJ72nuQuEpr76r8MNLoBa/GEEkMOae231hNmhfdEjUM 46CksPtATm2xyljKSAtq4vbur5v4Vfv80ehSNWq0yUyjEFuXL8BAsnvJxm0G162drjNE 4rbrucLOQdHaMPqc0JOPTIvFrWpILyzHJyAe0LJUiZniAKtVaqzXq/D++7FVojYb6dIg 5Yi7/SzRuKo7iTU+IEuXZJyvqudNju1uYquZBuBU1SKoGj1MzQuU+BNOQE3GPUXfcsuz 1YrQ== X-Received: by 10.50.91.195 with SMTP id cg3mr4082318igb.57.1359563270530; Wed, 30 Jan 2013 08:27:50 -0800 (PST) MIME-Version: 1.0 Received: by 10.64.9.226 with HTTP; Wed, 30 Jan 2013 08:27:30 -0800 (PST) In-Reply-To: <5D3AA85E9BCE45D0B204586E397BAE6E@gmail.com> References: <5D3AA85E9BCE45D0B204586E397BAE6E@gmail.com> From: Harsh J Date: Wed, 30 Jan 2013 21:57:30 +0530 Message-ID: Subject: Re: what will happen when HDFS restarts but with some dead nodes To: "" Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQlIJg58/QjTxa4KCtdeJ2wYBBFR9wgd5SOUvUJPBe+J/JWZQuoGP8hccABvLMpsJXEnFHYR X-Virus-Checked: Checked by ClamAV on apache.org NN does recalculate new replication work to do due to unavailable replicas ("under-replication") when it starts and receives all block reports, but executes this only after out of safemode. When in safemode, across the HDFS services, no mutations are allowed. On Wed, Jan 30, 2013 at 8:34 AM, Nan Zhu wrote: > Hi, all > > I'm wondering if HDFS is stopped, and some of the machines of the cluster > are moved, some of the block replication are definitely lost for moving > machines > > when I restart the system, will the namenode recalculate the data > distribution? > > Best, > > -- > Nan Zhu > School of Computer Science, > McGill University > > -- Harsh J