hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-2816) Cluster summary at name node web has confusing report for space utilization
Date Fri, 19 Sep 2008 00:56:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Suresh Srinivas updated HADOOP-2816:

    Attachment: HADOOP-2816.patch

Thanks for the review. I have uploaded new patch with the changes.

1. FSDataSet.java: getCapacity() should make sure that it does not return a negative number.
> Done

2. FSNamesystem.java: In getCapacityUsedPercent(), used space should be divided by the present
capacity. FSNamesystem probably should not have this public method since it is only used in
a test.
> Thanks for the catch. The testcase passed because used was a very small number. Hence
the used/remaining ~= used/present capacity
> I think it is a good idea to keep the method public. This ensures used percentage calculation
correctly uses present capacity and how it is done need not be known to users of the capacity
information. This will help consistent calculation of the percentage used data.  

3. DatanodeInfo.getDfsUsedPercent should check the case that the present capacity is zero.
Again, I do not think this public method needs to add to the class since it is only used in
webUI and the test.
> I think it is probably good idea to keep it as a public method

4. In webUI, better to rename "Total Capacity" to be "Configured Capacity" to show that it
is different from the old definition.
> Changed

5. Since the capacity field in the heartbeat has a new definition, should we bump up the DatanodeProtocol
> Done. Updated the protocol version number

Additionally a new JIRA will be created to keep track of reporting the capacity for DFSAdmin
report and other CLIs that are impacted by this change. This change only addresses the Web

> Cluster summary at name node web has confusing report for space utilization
> ---------------------------------------------------------------------------
>                 Key: HADOOP-2816
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2816
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: dfs
>            Reporter: Robert Chansler
>            Assignee: Suresh Srinivas
>             Fix For: 0.19.0
>         Attachments: HADOOP-2816.patch, HADOOP-2816.patch
> In one example:
> Cluster Summary
> Capacity	:	1.15 PB
> DFS Remaining	:	192 TB
> DFS Used	:	717 TB
> DFS Used%	:	62 %
> Why is Capacity not equal Used plus Remaining?
> (The answer is that there is an estimated reserve for local files.)
> The presentation should be easily understood by the user.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message