hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yufei Gu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-6522) Make SLS JSON input file format simple and scalable
Date Fri, 28 Apr 2017 19:40:04 GMT

     [ https://issues.apache.org/jira/browse/YARN-6522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yufei Gu updated YARN-6522:
---------------------------
    Description: 
SLS input format is verbose, and it doesn't scale out. We can improve it in these ways:
# We need to configure tasks one by one if there are more than one task in a job, which means
the job configuration usually includes lots of redundant items. To specify the number of task
for task configuration will solve this issue.
# Container host is useful for locality testing. It is obnoxious to specify container host
for each task for tests unrelated to locality. We would like to make it optional.
# For most tests, we don't care about job.id. Make it optional and generated automatically
by default.
# job.finish.ms doesn't make sense, just remove it.
# container type and container priority should be optional as well. 

  was:
SLS input format is verbose, and it doesn't scale out. We can improve it in these ways:
# We need to configure tasks one by one if there are more than one task in a job, which means
the job configuration usually includes lots of redundant items. Specify the number task for
a task configuration will solve this issue.
# Container host is useful for locality testing. It is obnoxious to specify container host
for each task for tests unrelated to locality. We would like to make it optional.
# For most tests, we don't care about job.id. Make it optional and generated automatically
by default.
# job.finish.ms doesn't make sense, just remove it.
# container type and container priority should be optional as well. 


> Make SLS JSON input file format simple and scalable
> ---------------------------------------------------
>
>                 Key: YARN-6522
>                 URL: https://issues.apache.org/jira/browse/YARN-6522
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: scheduler-load-simulator
>    Affects Versions: 3.0.0-alpha2
>            Reporter: Yufei Gu
>            Assignee: Yufei Gu
>         Attachments: YARN-6522.001.patch
>
>
> SLS input format is verbose, and it doesn't scale out. We can improve it in these ways:
> # We need to configure tasks one by one if there are more than one task in a job, which
means the job configuration usually includes lots of redundant items. To specify the number
of task for task configuration will solve this issue.
> # Container host is useful for locality testing. It is obnoxious to specify container
host for each task for tests unrelated to locality. We would like to make it optional.
> # For most tests, we don't care about job.id. Make it optional and generated automatically
by default.
> # job.finish.ms doesn't make sense, just remove it.
> # container type and container priority should be optional as well. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message