Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-dev@hadoop.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns;
	h=received:x-mimeole:content-class:mime-version:
	content-type:content-transfer-encoding:subject:date:message-id:
	in-reply-to:x-ms-has-attach:x-ms-tnef-correlator:thread-topic:
	thread-index:references:from:to:return-path:x-originalarrivaltime;
	b=wITOR9XrFliWrEIwt+kFmWvkGiDiQt9UM2CSmT7Zfzj7Hgm/7xaYF3fObklKWeyW
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Subject: RE: Specifying the positions of replicas
Date: Mon, 25 Feb 2008 16:08:16 -0800
Message-ID: 
 <84E52AD05F6F884AAFF3344FE4C95991011E598D@SNV-EXVS08.ds.corp.yahoo.com>
In-Reply-To: <256fdd860802251431k3ec970far56f40df654e5e4bb@mail.gmail.com>
Thread-Topic: Specifying the positions of replicas
Thread-Index: Ach3/poNLKSq1PoSSFehr3stMuekMAADPzYw
References: <256fdd860802251431k3ec970far56f40df654e5e4bb@mail.gmail.com>
From: "dhruba Borthakur" <dhruba@yahoo-inc.com>
To: <core-dev@hadoop.apache.org>

Maybe using LOG.warn("function name") will get your stuff into the
namenode log file.

Thanks,
Dhruba


-----Original Message-----
From: Zhu Huijun [mailto:nautilushj@gmail.com]=20
Sent: Monday, February 25, 2008 2:32 PM
To: core-dev@hadoop.apache.org
Subject: Specifying the positions of replicas

Hi, all,

Currently our group want to try some new data layout schemes on Hadoop,
but
I encounter some problems.

In Hadoop, each block has 3 replicas by default. It is said in the
documents
that two of them are put randomly in the same rack, and the third is put
at
another rack. This procedure is also clear in the source code of the
class
org.apache.hadoop.dfs.ReplicationTargetChooser.

What I did was adding a simple System.out.println("function name")
clause in
each function in ReplicationTargetChooser, and intended to check which
ones
are called to select the target nodes for replicas. However, when I use
"./bin/hadoop dfs -copyFromLocal" command to copy some files from the
local
file system to HDFS, it seems none of the functions in the
ReplicationTargetChooser is called, because nothing is printed out on
the
screen or the log files.

I preciate if someone can tell me where I can modify to control the
target
nodes of replicas. Thank you!

Have a nice day!

Huijun Zhu