hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-508) Consider making local-dir deletion optionally inline on NM startup
Date Mon, 25 Mar 2013 22:29:15 GMT
Siddharth Seth created YARN-508:
-----------------------------------

             Summary: Consider making local-dir deletion optionally inline on NM startup
                 Key: YARN-508
                 URL: https://issues.apache.org/jira/browse/YARN-508
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Siddharth Seth


YARN-71 added background local-dir creation on NM startup. 
This could lead to an unexpected performance degradation while the deletion completes (can
take time dependent on the configured dist cache size). We could make inline deletion an option
- so that the NM only registers with the RM after deletion completes. Rolling upgrades being
as use case where this could make a difference.

Also, the NM should wait for at least some disk space to be available before registering with
the RM.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message