hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator
Date Thu, 13 Apr 2017 19:18:41 GMT

    [ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968110#comment-15968110
] 

Wangda Tan commented on YARN-6363:
----------------------------------

Thanks [~curino],

For the patch:

My biggest concern is compatibility:
- This patch removed several options, if you plan to commit this patch to trunk (hadoop-3)
only, it is fine. However it will be problematic if you want to commit it to branch-2. Do
you think we should make it work in a compatible way?

Other comments:
-  It looks {{--nodes}} not honored by the new patch. SLSRunner#nodeFile not read by anyone.

Also I tested the patch, it works fine for the original SLS load. However I cannot get it
run for SYNTH workload, it get stuck before RM get started (I cannot access web UI). I uploaded
jstack output to: https://www.dropbox.com/s/tz5qaxy5qqt7j44/YARN-6363-jstack.001.txt?dl=0.

And this is the command I'm using: 
{code}
./bin/slsrun.sh --tracetype=SYNTH --tracelocation=src/test/resources/syn.json --output-dir=/tmp/sls-out
{code}

I'm using {{hadoop-tools/hadoop-sls/src/main/sample-conf}} as HADOOP_CONF_DIR.

Could you please share an example about how to run the SYNTH sls?


> Extending SLS: Synthetic Load Generator
> ---------------------------------------
>
>                 Key: YARN-6363
>                 URL: https://issues.apache.org/jira/browse/YARN-6363
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Carlo Curino
>            Assignee: Carlo Curino
>         Attachments: YARN-6363 overview.pdf, YARN-6363.v0.patch, YARN-6363.v1.patch,
YARN-6363.v2.patch, YARN-6363.v3.patch, YARN-6363.v4.patch, YARN-6363.v5.patch, YARN-6363.v6.patch,
YARN-6363.v7.patch, YARN-6363.v9.patch
>
>
> This JIRA tracks the introduction of a synthetic load generator in the SLS. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message