Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 54830DF6A for ; Fri, 14 Sep 2012 04:29:02 +0000 (UTC) Received: (qmail 75360 invoked by uid 500); 14 Sep 2012 04:28:57 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 75118 invoked by uid 500); 14 Sep 2012 04:28:56 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 75093 invoked by uid 99); 14 Sep 2012 04:28:55 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Sep 2012 04:28:55 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.214.176 as permitted sender) Received: from [209.85.214.176] (HELO mail-ob0-f176.google.com) (209.85.214.176) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Sep 2012 04:28:48 +0000 Received: by obbtb18 with SMTP id tb18so7447901obb.35 for ; Thu, 13 Sep 2012 21:28:28 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding:x-gm-message-state; bh=x/ZaEP4f8YD8aeIMbCGb3DPdLfyvJaIUBn5btTlf6IM=; b=JP5/6R+oDnCgSzPLJes1M4gbS6oYQ+S/KxlfXRj0aH73koFOldwPAQD1Vg21tKh2X7 zlZ4UDNDLsterO+Adx+AeDKBE834VJLUVqXKryjahW6Qz5yETmDQc7OJcfC/MvrSnuWo 5gMFJ8Vkh8mmHtJghxUxR0FA4r0AJjBW7c4VmK5TWumZQa/APnnTVIcncL+ELbDfn/IM udkcBQAEnbyFf3CsUo70EWlbBw0kwSvfrAwkup4EjcO80y9xu/Dh1pwy2RM+3bMBpX+Y 1/XPt3nmgN160B8jhGqNnkXtUKEAgxBeZNMZDKMzLpTbJN1Mq4lMmUUzQrpCf034Oiyb 4tNA== Received: by 10.60.26.133 with SMTP id l5mr1392613oeg.60.1347596907941; Thu, 13 Sep 2012 21:28:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.76.11.168 with HTTP; Thu, 13 Sep 2012 21:28:07 -0700 (PDT) In-Reply-To: References: From: Harsh J Date: Fri, 14 Sep 2012 09:58:07 +0530 Message-ID: Subject: Re: rack topology data update To: Jameson Li Cc: user@hadoop.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQmyXJKd2fx1p8ZBqyDkb9gdnggYrM8Ds98JwCOOtHJOoMCkaK1F3eU092vksPx4FfdZvupr Jameson, Yes unfortunately this is the current case. On Fri, Sep 14, 2012 at 8:58 AM, Jameson Li wrote: > Harsh J, > > If a new datanode has joined the cluster, and has a default rack info cac= hed > in the namenode, it will no way to change its cache other than restart th= e > namenode. > Am I right? > > =E4=B8=93=E6=B3=A8=E4=BA=8EMysql,MSSQL,Oracle,Hadoop > > > > 2012/9/13 Harsh J >> >> Hey Steve, >> >> True about the decisions part, that still needs the ugly fixing of >> re-replication. >> >> I think I saw it on a JIRA by Patrick A. that was trying to change the >> way we did this. But placement is also pluggable in 2.x right? Let me >> find that JIRA (but yeah, am unsure if it was committed). >> >> On Thu, Sep 13, 2012 at 2:40 PM, Steve Loughran >> wrote: >> > >> > >> > On 13 September 2012 09:03, Harsh J wrote: >> >> >> >> >> >> This should be fixed in one of the 2.x releases, where we also refres= h >> >> the cached values. >> >> >> > >> > Really? Which JIRA? >> > >> > I've been making changes to the topology logic so you can do some >> > preflight >> > checking and dump the topologies, but didn't think a clear and reload >> > was in >> > there. Some decisions on block placement strategy (flat vs hierarchica= l) >> > are >> > made early on, so going from flat to multi-switch is not something I'd >> > recommend. >> >> >> >> -- >> Harsh J > > --=20 Harsh J