Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BE7E67D7A for ; Wed, 7 Dec 2011 05:02:08 +0000 (UTC) Received: (qmail 59367 invoked by uid 500); 7 Dec 2011 05:02:07 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 59293 invoked by uid 500); 7 Dec 2011 05:02:04 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 59278 invoked by uid 99); 7 Dec 2011 05:02:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Dec 2011 05:02:00 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.210.176 as permitted sender) Received: from [209.85.210.176] (HELO mail-iy0-f176.google.com) (209.85.210.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Dec 2011 05:01:52 +0000 Received: by iakk12 with SMTP id k12so402640iak.35 for ; Tue, 06 Dec 2011 21:01:31 -0800 (PST) Received: by 10.50.51.234 with SMTP id n10mr18053889igo.10.1323234091692; Tue, 06 Dec 2011 21:01:31 -0800 (PST) Received: from [192.168.1.2] ([59.92.48.2]) by mx.google.com with ESMTPS id el2sm2185112ibb.10.2011.12.06.21.01.29 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 06 Dec 2011 21:01:30 -0800 (PST) Subject: Re: how to select the position of a block Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=utf-8 From: Harsh J X-Priority: 3 In-Reply-To: <13420f2a.81d9.134167c390a.Coremail.guochonghenu@126.com> Date: Wed, 7 Dec 2011 10:31:26 +0530 Content-Transfer-Encoding: quoted-printable Message-Id: References: <1729736192.22844.1321055334128.JavaMail.tomcat@hel.zones.apache.org> <13420f2a.81d9.134167c390a.Coremail.guochonghenu@126.com> To: hdfs-dev@hadoop.apache.org X-Mailer: Apple Mail (2.1084) Moving discussion to hdfs-dev. DataNodes report disk usage (space) and current transfer thread counts = (load) periodically to the NameNode. NameNode uses this information to = make a decision while building the pipeline DNs for your client request. = I believe the class is called something like ReplicationTargetChooser = (off the top of my mind), and you can take a look at the logic involved = there in selecting any form of node (isGoodTarget or summat). Then work = your way downwards to see how the information flows. On 07-Dec-2011, at 8:36 AM, =E9=83=AD=E5=86=B2 wrote: > Hadoop:The Definitive Guide said that when the client is out of the = cluster, hadoop will select the storage position of a block randomly,but = it will not select the datanode which is too busy or too full. >=20 > so i want to kown that how hadoop judge or measure a datanode is full = or not?