hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Difference between DFS Used and Non-DFS Used
Date Fri, 08 Jul 2011 11:11:58 GMT
It is just for information's sake (cause it can be computed with the
data collected). The space is accounted just to let you know that
there's something being stored on the DataNodes apart from just the
HDFS data, in case you are running out of space.

On Fri, Jul 8, 2011 at 10:18 AM, Sagar Shukla
<sagar_shukla@persistent.co.in> wrote:
> Hi Harsh,
>     Thanks for your reply.
>
> But why does it require non-DFS storage ? And why that space is accounted differently
from regular DFS storage ?
>
> Ideally, it should have been part of same storage.
>
> Thanks,
> Sagar
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: Thursday, July 07, 2011 6:04 PM
> To: common-user@hadoop.apache.org
> Subject: Re: Difference between DFS Used and Non-DFS Used
>
> DFS used is a count of all the space used by the dfs.data.dirs. The
> non-dfs used space is whatever space is occupied beyond that (which
> the DN does not account for).
>
> On Thu, Jul 7, 2011 at 3:29 PM, Sagar Shukla
> <sagar_shukla@persistent.co.in> wrote:
>> Hi,
>>       What is the difference between DFS Used and Non-DFS used ?
>>
>> Thanks,
>> Sagar
>>
>> DISCLAIMER
>> ==========
>> This e-mail may contain privileged and confidential information which is the property
of Persistent Systems Ltd. It is intended only for the use of the individual or entity to
which it is addressed. If you are not the intended recipient, you are not authorized to read,
retain, copy, print, distribute or use this message. If you have received this communication
in error, please notify the sender and delete all copies of this message. Persistent Systems
Ltd. does not accept any liability for virus infected mails.
>>
>>
>
>
>
> --
> Harsh J
>
> DISCLAIMER
> ==========
> This e-mail may contain privileged and confidential information which is the property
of Persistent Systems Ltd. It is intended only for the use of the individual or entity to
which it is addressed. If you are not the intended recipient, you are not authorized to read,
retain, copy, print, distribute or use this message. If you have received this communication
in error, please notify the sender and delete all copies of this message. Persistent Systems
Ltd. does not accept any liability for virus infected mails.
>
>



-- 
Harsh J

Mime
View raw message