hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sandflee (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers
Date Tue, 09 Aug 2016 17:08:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413844#comment-15413844
] 

sandflee edited comment on YARN-5483 at 8/9/16 5:08 PM:
--------------------------------------------------------

1, update a new patch to fix some other diamond operator issues
2, in branch-2.7.patch
{code}
        finishedContainersSentToAM.putIfAbsent(nodeId,
            new ArrayList<>());
{code}
this leads to compile errors about "java.util.ArrayList<java.lang.Object>can't cast
to java.util.List<org.apache.hadoop.yarn.api.records.ContainerStatus>)", I don;t known
why, so removed the related fix.



was (Author: sandflee):
1, update a new patch to minor fix diamond operator issues
2, in branch-2.7.patch
{code}
        finishedContainersSentToAM.putIfAbsent(nodeId,
            new ArrayList<>());
{code}
this leads to compile errors about "java.util.ArrayList<java.lang.Object>can't cast
to java.util.List<org.apache.hadoop.yarn.api.records.ContainerStatus>)", I don;t known
why, so removed the related fix.


> Optimize RMAppAttempt#pullJustFinishedContainers
> ------------------------------------------------
>
>                 Key: YARN-5483
>                 URL: https://issues.apache.org/jira/browse/YARN-5483
>             Project: Hadoop YARN
>          Issue Type: Improvement
>    Affects Versions: 2.6.0
>            Reporter: sandflee
>            Assignee: sandflee
>         Attachments: YARN-5483-branch-2.6.patch, YARN-5483-branch-2.7.patch, YARN-5483.01.patch,
YARN-5483.02.patch, YARN-5483.03.patch, YARN-5483.04.patch, jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers cost too
much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message