tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-336) AMContainerImpl are stored even after container has completed
Date Thu, 29 Aug 2013 17:26:51 GMT

    [ https://issues.apache.org/jira/browse/TEZ-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753833#comment-13753833

Bikas Saha commented on TEZ-336:

Looks like you are correct. At some point we need to profile the memory of the AM and see
if we need to fix something.
> AMContainerImpl are stored even after container has completed
> -------------------------------------------------------------
>                 Key: TEZ-336
>                 URL: https://issues.apache.org/jira/browse/TEZ-336
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Bikas Saha
>            Assignee: joeyli
>              Labels: TEZ-0.2.0
>             Fix For: 0.2.0
>         Attachments: TEZ-336.3.patch
> For a long running job thats allocated 100's of 1000's of containers this can be a memory
usage issue. Even if AMContainerImpls are small they contain full copies of container launch
context objects that look like heavy weights with multiple maps of local resources, env etc.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message