hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Shah (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-541) getAllocatedContainers() is not returning all the allocated containers
Date Mon, 15 Jul 2013 04:52:49 GMT

    [ https://issues.apache.org/jira/browse/YARN-541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708235#comment-13708235
] 

Hitesh Shah commented on YARN-541:
----------------------------------

[~write2kishore] Logs, if you get a chance, would help to confirm if the issue that you saw
was the same as the one that was reproduced by Bikas when providing the fix. If you can take
the patch attached to the jira and try it out to see if it addresses the issue in your env,
that would be great too. 



 
                
> getAllocatedContainers() is not returning all the allocated containers
> ----------------------------------------------------------------------
>
>                 Key: YARN-541
>                 URL: https://issues.apache.org/jira/browse/YARN-541
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.0.3-alpha
>         Environment: Redhat Linux 64-bit
>            Reporter: Krishna Kishore Bonagiri
>            Assignee: Bikas Saha
>            Priority: Blocker
>             Fix For: 2.1.0-beta
>
>         Attachments: AppMaster.stdout, YARN-541.1.patch, yarn-dsadm-nodemanager-isredeng.out,
yarn-dsadm-resourcemanager-isredeng.out
>
>
> I am running an application that was written and working well with the hadoop-2.0.0-alpha
but when I am running the same against 2.0.3-alpha, the getAllocatedContainers() method called
on AMResponse is not returning all the containers allocated sometimes. For example, I request
for 10 containers and this method gives me only 9 containers sometimes, and when I looked
at the log of Resource Manager, the 10th container is also allocated. It happens only sometimes
randomly and works fine all other times. If I send one more request for the remaining container
to RM after it failed to give them the first time(and before releasing already acquired ones),
it could allocate that container. I am running only one application at a time, but 1000s of
them one after another.
> My main worry is, even though the RM's log is saying that all 10 requested containers
are allocated,  the getAllocatedContainers() method is not returning me all of them, it returned
only 9 surprisingly. I never saw this kind of issue in the previous version, i.e. hadoop-2.0.0-alpha.
> Thanks,
> Kishore
>  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message