hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Chansler (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2816) Cluster summary at name node web has confusing report for space utilization
Date Tue, 05 Aug 2008 23:30:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12620086#action_12620086
] 

Robert Chansler commented on HADOOP-2816:
-----------------------------------------

Consensus recommendation from M, K, A, H, S, R:

Allocation and management algorithms will not change, but reporting on the Name Node home
page should be modified:

In the node table, four statistics will be reported: 

    "Configured Capacity" is the sum over all volumes V named in config:dfs.data.dir that
exist of (df.Size V - config:dfs.datanode.du.reserved)   
    "Present Capacity" is df.Size V - MAX{df.Used V - [space used to store block and metadata
files], config:dfs.datanode.du.reserved)
    "Used (%)" is the ratio of [space used to store block and metadata files] and Present
Capacity (the little gauge reflects this value)
    "Remaining" is the difference Present Capacity - [space used to store block and metadata
files]


The "cluster summary" will report 5 statistics:

    "Configured Capacity" is the sum over all data nodes D of d.ConfiguredCapacity
    "Present Capacity" is the sum over all data nodes of D of D.PresentCapacity
    "Used"  is the sum over all data nodes of D of D.[space used to store block and metadata
files]
    "Remaining" is the difference Present Capacity - Used
    "Used %" is the ratio of Used to Present Capacity

A key will explain these calculations for the user.




> Cluster summary at name node web has confusing report for space utilization
> ---------------------------------------------------------------------------
>
>                 Key: HADOOP-2816
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2816
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: dfs
>    Affects Versions: 0.15.3
>            Reporter: Robert Chansler
>
> In one example:
> Cluster Summary
> Capacity	:	1.15 PB
> DFS Remaining	:	192 TB
> DFS Used	:	717 TB
> DFS Used%	:	62 %
> Why is Capacity not equal Used plus Remaining?
> (The answer is that there is an estimated reserve for local files.)
> The presentation should be easily understood by the user.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message