Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of jason.hadoop@gmail.com
 designates 209.85.146.180 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=TI4bbdlAGQk4iFkv6ehlwmuA/t2e8mbhcYtwS1W1jX49PIZsMU9YWnLDNaaynWm1kI
         iKHa5JHTn0ydr6g2efw7UcmgaU7rHPzlILVHmRCLI/D9d8+kmg5+Pp63OnH917nb999t
         4Mm185sjIC3nwT7mIZxfxf23cf/qeq3bW565w=
MIME-Version: 1.0
In-Reply-To: 
 <E3137F97B0A0804194F369F4E7C3B71923102D5CE6@EXCHANGE.persistent.co.in>
References: 
 <E3137F97B0A0804194F369F4E7C3B71923102D5CE6@EXCHANGE.persistent.co.in>
Date: Mon, 27 Apr 2009 00:49:32 -0700
Message-ID: <314098690904270049m1baeb82r62fdbc8c307a6b77@mail.gmail.com>
Subject: Re: Storing data-node content to other machine
From: jason hadoop <jason.hadoop@gmail.com>
To: core-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001636417e653bf53404688496c5

--001636417e653bf53404688496c5
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

There is no requirement that your hdfs and mapred clusters share an
installation directory, it is just done that way because it is simple and
most people have a datanode and tasktracker on each slave node.

Simply have 2 configuration directories on your cluster machines, and us the
bin/start-dfs.sh script in one, and the bin/start-mapred.sh script in the
other, and maintain different slaves files in the two directories.

You will loose the benefit of data locality for your tasktrackers which do
not reside on the datanode machines.

On Sun, Apr 26, 2009 at 10:06 PM, Vishal Ghawate <
vishal_ghawate@persistent.co.in> wrote:

> Hi,
> I want to store the contents of all the client machine(datanode)of hadoop
> cluster to centralized machine
>  with high storage capacity.so that tasktracker will be on the client
> machine but the contents are stored on the
> centralized machine.
>                Can anybody help me on this please.
>
> DISCLAIMER
> ==========
> This e-mail may contain privileged and confidential information which is
> the property of Persistent Systems Ltd. It is intended only for the use of
> the individual or entity to which it is addressed. If you are not the
> intended recipient, you are not authorized to read, retain, copy, print,
> distribute or use this message. If you have received this communication in
> error, please notify the sender and delete all copies of this message.
> Persistent Systems Ltd. does not accept any liability for virus infected
> mails.
>


-- 
Alpha Chapters of my book on Hadoop are available
http://www.apress.com/book/view/9781430219422

--001636417e653bf53404688496c5--