tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-336) AMContainerImpl are stored even after container has completed
Date Mon, 26 Aug 2013 17:00:54 GMT

    [ https://issues.apache.org/jira/browse/TEZ-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750239#comment-13750239

Bikas Saha commented on TEZ-336:

you should look at the new ContainerContext class that recently got added in TEZ-384
> AMContainerImpl are stored even after container has completed
> -------------------------------------------------------------
>                 Key: TEZ-336
>                 URL: https://issues.apache.org/jira/browse/TEZ-336
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Bikas Saha
>            Assignee: joeyli
>              Labels: TEZ-0.2.0
>             Fix For: 0.2.0
>         Attachments: TEZ-336.3.patch
> For a long running job thats allocated 100's of 1000's of containers this can be a memory
usage issue. Even if AMContainerImpls are small they contain full copies of container launch
context objects that look like heavy weights with multiple maps of local resources, env etc.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message