hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Shah (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3946) If a resource requirement is higher than available on any node, job should fail early
Date Thu, 01 Mar 2012 02:35:58 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219745#comment-13219745
] 

Hitesh Shah commented on MAPREDUCE-3946:
----------------------------------------

This probably could probably be marked as a duplicate for MAPREDUCE-3796. 

MR-3796 is meant to be more yarn-specific to ensure that the application submission should
fail if the AM memory request exceeds max allowed. However this jira may still be needed if
the job client does not handle app submission failures properly. 
                
> If a resource requirement is higher than available on any node, job should fail early
> -------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3946
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3946
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 0.24.0, 0.23.2
>            Reporter: Todd Lipcon
>
> If you configure the NMs to have 1GB of RAM each, and then try to submit a job which
has an AM resource requirement of 1.5GB, the job will neither run nor fail. Instead, it will
slowly sop of all of the resources in the cluster as "reservations" despite the fact that
it will never be able to schedule something. Instead, it should fail early indicating that
the required memory allocation is infeasible.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message