hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brahma Reddy Battula (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.
Date Fri, 20 Nov 2015 19:06:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018549#comment-15018549
] 

Brahma Reddy Battula commented on HDFS-9038:
--------------------------------------------

This is not failing locally.But there is chance that this testcase can fail intermittently
after this change(There is a chance that nonDFS usage might have slightly due to testlogs,).So
I am keeping safeside as I did {{TestNamenodeCapacityReport.java}} 

 *Check following results for same* 

||Testenv||dfsused||dfsremaining||nondfsused||TotalCapacity||difference||
|Eclipse| 888|570023337984|74221730952|644245069824|0|
|jenkins Run| 147456|20430970142720|2887306715136|23318276997120|8192|

> Reserved space is erroneously counted towards non-DFS used.
> -----------------------------------------------------------
>
>                 Key: HDFS-9038
>                 URL: https://issues.apache.org/jira/browse/HDFS-9038
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 2.7.1
>            Reporter: Chris Nauroth
>            Assignee: Brahma Reddy Battula
>         Attachments: HDFS-9038-002.patch, HDFS-9038-003.patch, HDFS-9038-004.patch, HDFS-9038.patch
>
>
> HDFS-5215 changed the DataNode volume available space calculation to consider the reserved
space held by the {{dfs.datanode.du.reserved}} configuration property.  As a side effect,
reserved space is now counted towards non-DFS used.  I don't believe it was intentional to
change the definition of non-DFS used.  This issue proposes restoring the prior behavior:
do not count reserved space towards non-DFS used.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message