hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2352) FairScheduler: Collect metrics on duration of critical methods that affect performance
Date Sat, 09 Aug 2014 11:32:16 GMT

    [ https://issues.apache.org/jira/browse/YARN-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091727#comment-14091727
] 

Hudson commented on YARN-2352:
------------------------------

SUCCESS: Integrated in Hadoop-Yarn-trunk #639 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/639/])
YARN-2352. Add missing file. FairScheduler: Collect metrics on duration of critical methods
that affect performance. (kasha) (kasha: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616784)
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FSOpDurations.java
YARN-2352. FairScheduler: Collect metrics on duration of critical methods that affect performance.
(kasha) (kasha: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616769)
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsCollectorImpl.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableStat.java
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/dev-support/findbugs-exclude.xml
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java


> FairScheduler: Collect metrics on duration of critical methods that affect performance
> --------------------------------------------------------------------------------------
>
>                 Key: YARN-2352
>                 URL: https://issues.apache.org/jira/browse/YARN-2352
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: scheduler
>    Affects Versions: 2.4.1
>            Reporter: Karthik Kambatla
>            Assignee: Karthik Kambatla
>             Fix For: 2.6.0
>
>         Attachments: fs-perf-metrics.png, yarn-2352-1.patch, yarn-2352-2.patch, yarn-2352-2.patch,
yarn-2352-3.patch, yarn-2352-4.patch, yarn-2352-5.patch, yarn-2352-6.patch
>
>
> We need more metrics for better visibility into FairScheduler performance. At the least,
we need to do this for (1) handle node events, (2) update, (3) compute fairshares, (4) preemption.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message