tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-336) AMContainerImpl are stored even after container has completed
Date Thu, 29 Aug 2013 17:28:53 GMT

    [ https://issues.apache.org/jira/browse/TEZ-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753837#comment-13753837

Bikas Saha commented on TEZ-336:

bq. On a related note, the same cleanup is likely required on completed TaskAttempts, Tasks
[~fiberlijun] Can you please check if the same cleanup is required on these other objects
or not. Based on that please feel free to make a fix in this jira or close it.
> AMContainerImpl are stored even after container has completed
> -------------------------------------------------------------
>                 Key: TEZ-336
>                 URL: https://issues.apache.org/jira/browse/TEZ-336
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Bikas Saha
>            Assignee: joeyli
>              Labels: TEZ-0.2.0
>             Fix For: 0.2.0
>         Attachments: TEZ-336.3.patch
> For a long running job thats allocated 100's of 1000's of containers this can be a memory
usage issue. Even if AMContainerImpls are small they contain full copies of container launch
context objects that look like heavy weights with multiple maps of local resources, env etc.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message