hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-19317) Increase "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage" to avoid host-related failures on MiniMRCluster
Date Tue, 21 Nov 2017 19:03:00 GMT

     [ https://issues.apache.org/jira/browse/HBASE-19317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Elser updated HBASE-19317:
-------------------------------
    Attachment: HBASE-19317.001.branch-2.patch

.001 Use Configuration's setIfUnset method to set a threshold of 99% instead of the default
90% when starting MiniMRCluster.

> Increase "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage"
to avoid host-related failures on MiniMRCluster
> ----------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-19317
>                 URL: https://issues.apache.org/jira/browse/HBASE-19317
>             Project: HBase
>          Issue Type: Bug
>          Components: integration tests, test
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 2.0.0-beta-1
>
>         Attachments: HBASE-19317.001.branch-2.patch
>
>
> YARN (2.7.4, at least) defaults to asserting at least 10% of the disk usage free on the
local machine in order for the NodeManagers to function.
> On my development machine, despite having over 50G free, I would see the warning from
the NM that all the local dirs were bad which would cause the test to become stuck waiting
to submit a mapreduce job. Surefire would eventually kill the process.
> We should increase this value to avoid it causing us headache.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message