hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "yunjiong zhao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-6339) Improve performance for createAndGetApplicationReport
Date Tue, 14 Mar 2017 23:04:41 GMT
yunjiong zhao created YARN-6339:

             Summary: Improve performance for createAndGetApplicationReport
                 Key: YARN-6339
                 URL: https://issues.apache.org/jira/browse/YARN-6339
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: yunjiong zhao
            Assignee: yunjiong zhao

There are two performance issue when calling createAndGetApplicationReport:
One is inside ProtoUtils.convertFromProtoFormat, replace is too slow for clusters which have
more than 3000 nodes. Use substring is much better: https://issues.apache.org/jira/browse/YARN-6285?focusedCommentId=15923241&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15923241

Another one is inside getLogAggregationReportsForApp, if some application's LogAggregationStatus
is TIME_OUT, every time it was called it will create an HashMap which will produce lots of

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

View raw message