hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-4619) Add support to scheduler load simulator to run NM and AM simulation separately from the RM process
Date Thu, 21 Jan 2016 06:13:39 GMT
Ming Ma created YARN-4619:
-----------------------------

             Summary: Add support to scheduler load simulator to run NM and AM simulation
separately from the RM process
                 Key: YARN-4619
                 URL: https://issues.apache.org/jira/browse/YARN-4619
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Ming Ma


Currently SLS run everything in one JVM. It has some limitations if we want to use the tool
to evaluate scheduler performance. For example, gc caused by the NM and AM simulation allocation
can impact the test; the simulation uses direct method calls into RM without using RPC.

First we need to refactor SLS to use RPC calls instead of direct calls, Then we can provide
options to start SLS in different modes, such as RM only, NM+AM simulation only. We can even
consider running distributed NM+AM simulations on different machines.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message