hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.
Date Thu, 03 Mar 2016 02:58:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177060#comment-15177060
] 

Arpit Agarwal edited comment on HDFS-9038 at 3/3/16 2:57 AM:
-------------------------------------------------------------

Hi [~brahmareddy], I am sorry this patch is stuck after all the effort you put into it.

There is a disagreement on the definition of non-DFS used space. Quoting [~cnauroth]:
bq. Essentially, it's a question of whether this metric means "Raw Non-DFS Used" or "Unplanned
Non-DFS Used".

I don't see any harm in starting a discussion on hdfs-dev. I will think about this some more.


was (Author: arpitagarwal):
Hi [~brahmareddy], I am sorry this patch is stuck after all the effort you put into it.

There is a disagreement on what the definition of non-DFS used space. Quoting [~cnauroth]:
bq. Essentially, it's a question of whether this metric means "Raw Non-DFS Used" or "Unplanned
Non-DFS Used".

I don't see any harm in starting a discussion on hdfs-dev. I will think about this some more.

> DFS reserved space is erroneously counted towards non-DFS used.
> ---------------------------------------------------------------
>
>                 Key: HDFS-9038
>                 URL: https://issues.apache.org/jira/browse/HDFS-9038
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 2.7.1
>            Reporter: Chris Nauroth
>            Assignee: Brahma Reddy Battula
>         Attachments: GetFree.java, HDFS-9038-002.patch, HDFS-9038-003.patch, HDFS-9038-004.patch,
HDFS-9038-005.patch, HDFS-9038-006.patch, HDFS-9038-007.patch, HDFS-9038.patch
>
>
> HDFS-5215 changed the DataNode volume available space calculation to consider the reserved
space held by the {{dfs.datanode.du.reserved}} configuration property.  As a side effect,
reserved space is now counted towards non-DFS used.  I don't believe it was intentional to
change the definition of non-DFS used.  This issue proposes restoring the prior behavior:
do not count reserved space towards non-DFS used.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message