Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of techie.anirudh@gmail.com
 designates 209.85.216.41 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CA+0nBG1Sv9wvms7ND3BD86geUJ7iT=wkjtF7EMk8SEiUYMfUww@mail.gmail.com>
References: 
 <CA+0nBG1Sv9wvms7ND3BD86geUJ7iT=wkjtF7EMk8SEiUYMfUww@mail.gmail.com>
Date: Sat, 31 Dec 2011 22:47:04 -0800
Message-ID: 
 <CADeA+y=0eXBk4yJy1Dx0GNpiTA1F_Kf=u0JvfS6YL+5pmWwRGA@mail.gmail.com>
Subject: Re: HDFS Datanode Capacity
From: Anirudh <techie.anirudh@gmail.com>
To: hdfs-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf30363eff8481df04b571d55d

--20cf30363eff8481df04b571d55d
Content-Type: text/plain; charset=ISO-8859-1

You may want to look at
http://hadoop.apache.org/hdfs/docs/current/hdfs_quota_admin_guide.html

Thanks,
Anirudh

On Sat, Dec 31, 2011 at 10:03 PM, Hamed Ghavamnia <ghavamnia.h@gmail.com>wrote:

> Hi,
> I've been searching on how to configure the maximum capacity of a
> datanode. I've added big volumes to one of my datanodes, but the configured
> capacity doesn't get bigger than the default 5GB. If I want a datanode with
> 100GB of capacity, I have to add 20 directories, each having 5GB so the
> maximum capacity reaches 100. Is there anywhere this can be set? Can
> different datanodes have different capacities?
>
> Also it seems like the *dfs.datanode.du.reserved *doesn't work either,
> because I've set it to zero, but it still leaves 50% of the free space for
> non-dfs usage.
>
> Thanks,
> Hamed
>
> P.S. This is my first message in the mailing list, so if I have to follow
> any rules for sending emails, I'll be thankful if you let me know. :)
>

--20cf30363eff8481df04b571d55d
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

You may want to look at <br>
<a href=3D"http://hadoop.apache.org/hdfs/docs/current/hdfs_quota_admin_guid=
e.html">http://hadoop.apache.org/hdfs/docs/current/hdfs_quota_admin_guide.h=
tml</a><br>
<br>
Thanks,<br>
Anirudh<br><br><div class=3D"gmail_quote">On Sat, Dec 31, 2011 at 10:03 PM,=
 Hamed Ghavamnia <span dir=3D"ltr">&lt;<a href=3D"mailto:ghavamnia.h@gmail.=
com">ghavamnia.h@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gm=
ail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-le=
ft:1ex">
Hi,<br>I&#39;ve been searching on how to configure the maximum capacity of =
a datanode. I&#39;ve added big volumes to one of my datanodes, but the conf=
igured capacity doesn&#39;t get bigger than the default 5GB. If I want a da=
tanode with 100GB of capacity, I have to add 20 directories, each having 5G=
B so the maximum capacity reaches 100. Is there anywhere this can be set? C=
an different datanodes have different capacities?<br>


<br>Also it seems like the <font size=3D"4"><b><code>dfs.datanode.du.reserv=
ed </code></b></font>doesn&#39;t work either, because I&#39;ve set it to ze=
ro, but it still leaves 50% of the free space for non-dfs usage.<br><br>

Thanks,<br>
Hamed<br><br>P.S. This is my first message in the mailing list, so if I hav=
e to follow any rules for sending emails, I&#39;ll be thankful if you let m=
e know. :)<br>
</blockquote></div><br>

--20cf30363eff8481df04b571d55d--