Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C94D9E6A0 for ; Wed, 30 Jan 2013 15:28:50 +0000 (UTC) Received: (qmail 1138 invoked by uid 500); 30 Jan 2013 15:28:46 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 767 invoked by uid 500); 30 Jan 2013 15:28:45 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 736 invoked by uid 99); 30 Jan 2013 15:28:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jan 2013 15:28:44 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of airbots@gmail.com designates 209.85.215.42 as permitted sender) Received: from [209.85.215.42] (HELO mail-la0-f42.google.com) (209.85.215.42) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jan 2013 15:28:37 +0000 Received: by mail-la0-f42.google.com with SMTP id fe20so1205573lab.29 for ; Wed, 30 Jan 2013 07:28:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=BlK01JRcKRccjofsq3Ks01LlGWy26YN0YE7COxBYghk=; b=ZjDpceIT+EiJSdhsmfslQ/rad9DIJKcossWvMT1fjXVw3OxjUSv5aDhUZ6B9FKNwt4 54e20n/E27KXmZpc59lsKQXw0XmW+LSBnGXcmJUuI3DVqi0nu4SGyEcjme2vgOiR1/FM t8qNCYXwPD4nL7fZpN3Ov7srdfaqyCUsVA3ja+Xlvk20Qw1YOYNqcVPNPm6pFnxOX+tP Is2KhfKGmLlRTzklvZyZLFYGfMLR41QvLx/snhL3NCs5q2mVQ+9pQQkD4hs4BViki8GF DYggJHI25mYSu+UR8rQ4saXvoRkRPGBJaPjLudBU8xvgaqJ+mRensLzaFuiRRfZoggD0 zm8g== MIME-Version: 1.0 X-Received: by 10.112.16.110 with SMTP id f14mr2074247lbd.126.1359559696790; Wed, 30 Jan 2013 07:28:16 -0800 (PST) Received: by 10.112.149.228 with HTTP; Wed, 30 Jan 2013 07:28:16 -0800 (PST) Received: by 10.112.149.228 with HTTP; Wed, 30 Jan 2013 07:28:16 -0800 (PST) In-Reply-To: References: <5D3AA85E9BCE45D0B204586E397BAE6E@gmail.com> Date: Wed, 30 Jan 2013 09:28:16 -0600 Message-ID: Subject: Re: what will happen when HDFS restarts but with some dead nodes From: Chen He To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=f46d0401fd91c7339504d4832805 X-Virus-Checked: Checked by ClamAV on apache.org --f46d0401fd91c7339504d4832805 Content-Type: text/plain; charset=ISO-8859-1 That is correct if you do not manually exit NN safemode. Regards Chen On Jan 30, 2013 8:59 AM, "Jean-Marc Spaggiari" wrote: > Hi Nan, > > When the Namenode will EXIT the safemode, you, you can assume that all > blocks ARE fully replicated. If the Namenode is still IN safemode that > mean that all blocks are NOT fully replicated. > > JM > > 2013/1/29, Nan Zhu : > > So, we can assume that all blocks are fully replicated at the start > point of > > HDFS? > > > > Best, > > > > -- > > Nan Zhu > > School of Computer Science, > > McGill University > > > > > > > > On Tuesday, 29 January, 2013 at 10:50 PM, Chen He wrote: > > > >> Hi Nan > >> > >> Namenode will stay in safemode before all blocks are replicated. During > >> this time, the jobtracker can not see any tasktrackers. (MRv1). > >> > >> Chen > >> > >> On Tue, Jan 29, 2013 at 9:04 PM, Nan Zhu >> (mailto:zhunansjtu@gmail.com)> wrote: > >> > Hi, all > >> > > >> > I'm wondering if HDFS is stopped, and some of the machines of the > >> > cluster are moved, some of the block replication are definitely lost > >> > for moving machines > >> > > >> > when I restart the system, will the namenode recalculate the data > >> > distribution? > >> > > >> > Best, > >> > > >> > -- > >> > Nan Zhu > >> > School of Computer Science, > >> > McGill University > >> > > >> > > >> > > > > > --f46d0401fd91c7339504d4832805 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

That is correct if you do not manually exit NN safemode.

Regards

Chen

On Jan 30, 2013 8:59 AM, "Jean-Marc Spaggia= ri" <jean-marc@spaggiari= .org> wrote:
Hi Nan,

When the Namenode will EXIT the safemode, you, you can assume that all
blocks ARE fully replicated. If the Namenode is still IN safemode that
mean that all blocks are NOT fully replicated.

JM

2013/1/29, Nan Zhu <zhunansjtu@g= mail.com>:
> So, we can assume that all blocks are fully replicated at the start po= int of
> HDFS?
>
> Best,
>
> --
> Nan Zhu
> School of Computer Science,
> McGill University
>
>
>
> On Tuesday, 29 January, 2013 at 10:50 PM, Chen He wrote:
>
>> Hi Nan
>>
>> Namenode will stay in safemode before all blocks are replicated. D= uring
>> this time, the jobtracker can not see any tasktrackers. (MRv1). >>
>> Chen
>>
>> On Tue, Jan 29, 2013 at 9:04 PM, Nan Zhu <zhunansjtu@gmail.com
>> (mailto:zhunansjtu@gmail.c= om)> wrote:
>> > Hi, all
>> >
>> > I'm wondering if HDFS is stopped, and some of the machine= s of the
>> > cluster are moved, =A0some of the block replication are defin= itely lost
>> > for moving machines
>> >
>> > when I restart the system, will the namenode recalculate the = data
>> > distribution?
>> >
>> > Best,
>> >
>> > --
>> > Nan Zhu
>> > School of Computer Science,
>> > McGill University
>> >
>> >
>>
>
>
--f46d0401fd91c7339504d4832805--