hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3946) If a resource requirement is higher than available on any node, job should fail early
Date Thu, 01 Mar 2012 03:24:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219767#comment-13219767

Vinod Kumar Vavilapalli commented on MAPREDUCE-3946:

Ah, I forgot about that. So, yes I think this is a duplicate.

Todd, essentially, we now have a cluster level configuration for max-resource-size which is
supposed to be set by cluster admins such that all nodes have greater than that. RM will reject
apps if the AM resource requirement is more than this. I think that should work, please close
this as duplicate if you agree too. Thanks.
> If a resource requirement is higher than available on any node, job should fail early
> -------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-3946
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3946
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 0.24.0, 0.23.2
>            Reporter: Todd Lipcon
> If you configure the NMs to have 1GB of RAM each, and then try to submit a job which
has an AM resource requirement of 1.5GB, the job will neither run nor fail. Instead, it will
slowly sop of all of the resources in the cluster as "reservations" despite the fact that
it will never be able to schedule something. Instead, it should fail early indicating that
the required memory allocation is infeasible.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message