Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of nitinpawar432@gmail.com
 designates 209.85.213.50 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAHv0dggzWOBL=CaaY98T9oYUJ1Jdy9Stwqpsii9swRSq31L0OQ@mail.gmail.com>
References: 
 <CAB1vRXSLYj1s0BtKoZM=6fZ7pvMFVGvvSOujLa6F6hFnpLY02A@mail.gmail.com>
	<CA+tdLAraiamU9qu6daqD3Qb0mfVBkkXbeOh4bvxKhOrWxjTo=w@mail.gmail.com>
	<CAHv0dggzWOBL=CaaY98T9oYUJ1Jdy9Stwqpsii9swRSq31L0OQ@mail.gmail.com>
Date: Tue, 13 May 2014 14:00:28 +0530
Message-ID: 
 <CAORpBsgURoBh8iS1NcxFaHuPV8WsefGHt4Qp83GowaTyQjQY3Q@mail.gmail.com>
Subject: Re: Data node with multiple disks
From: Nitin Pawar <nitinpawar432@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf3011dff54ff41904f943e08f

--20cf3011dff54ff41904f943e08f
Content-Type: text/plain; charset=UTF-8

Hi Marcos,
If these discs are not shared across nodes, I would not worry. Hadoop takes
care of making sure data is not replicated to single node.

But if all these 20 nodes are sharing these 10 HDD's,

Then you may have to basically assign specific disc to specific node and
make your cluster rack aware so that the replication in same rack would go
to different node and replication to second rack will to new disc.


On Tue, May 13, 2014 at 1:38 PM, kishore alajangi <alajangikishore@gmail.com
> wrote:

> replication factor=1
>
>
> On Tue, May 13, 2014 at 11:04 AM, SF Hadoop <sfhadoop@gmail.com> wrote:
>
>> Your question is unclear. Please restate and describe what you are
>> attempting to do.
>>
>> Thanks.
>>
>>
>> On Monday, May 12, 2014, Marcos Sousa <falecomigo@marcossousa.com> wrote:
>>
>>> Hi,
>>>
>>> I have 20 servers with 10 HD with 400GB SATA. I'd like to use them to be
>>> my datanode:
>>>
>>> /vol1/hadoop/data
>>> /vol2/hadoop/data
>>> /vol3/hadoop/data
>>> /volN/hadoop/data
>>>
>>> How do user those distinct discs not to replicate?
>>>
>>> Best regards,
>>>
>>> --
>>> Marcos Sousa
>>>
>>
>
>
> --
> Thanks,
> Kishore.
>


-- 
Nitin Pawar

--20cf3011dff54ff41904f943e08f
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Marcos,<div>If these discs are not shared across nodes,=
 I would not worry. Hadoop takes care of making sure data is not replicated=
 to single node.=C2=A0</div><div><br></div><div>But if all these 20 nodes a=
re sharing these 10 HDD&#39;s,=C2=A0</div>
<div><br></div><div>Then you may have to basically assign specific disc to =
specific node and make your cluster rack aware so that the replication in s=
ame rack would go to different node and replication to second rack will to =
new disc.=C2=A0</div>
<div><br></div><div><br></div><div><br></div></div><div class=3D"gmail_extr=
a"><br><br><div class=3D"gmail_quote">On Tue, May 13, 2014 at 1:38 PM, kish=
ore alajangi <span dir=3D"ltr">&lt;<a href=3D"mailto:alajangikishore@gmail.=
com" target=3D"_blank">alajangikishore@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">replication factor=3D1<br><=
/div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Tue, =
May 13, 2014 at 11:04 AM, SF Hadoop <span dir=3D"ltr">&lt;<a href=3D"mailto=
:sfhadoop@gmail.com" target=3D"_blank">sfhadoop@gmail.com</a>&gt;</span> wr=
ote:<br>

<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Your question is unclear. Please restate and=
 describe what you are attempting to do.<div><br></div><div>Thanks.=C2=A0</=
div>
<div><div class=3D"h5"><div>
<br></div><div><br>On Monday, May 12, 2014, Marcos Sousa &lt;<a href=3D"mai=
lto:falecomigo@marcossousa.com" target=3D"_blank">falecomigo@marcossousa.co=
m</a>&gt; wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div><br></div><div>I ha=
ve 20 servers with 10 HD with 400GB SATA. I&#39;d like to use them to be my=
 datanode:=C2=A0</div>


<div><br></div><div>/vol1/hadoop/data</div><div>/vol2/hadoop/data<br></div>=
<div>/vol3/hadoop/data<br>

</div><div>/volN/hadoop/data<br></div><div><br></div><div>How do user those=
 distinct discs not to replicate?</div><div><br></div><div>Best regards,</d=
iv><span><font color=3D"#888888"><div><div><br></div>-- <br>
Marcos Sousa</div></font></span></div>
</blockquote></div>
</div></div></blockquote></div><span class=3D"HOEnZb"><font color=3D"#88888=
8"><br><br clear=3D"all"><br>-- <br>Thanks,<br>Kishore.
</font></span></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>Nitin Pawar<=
br>
</div>

--20cf3011dff54ff41904f943e08f--