hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-8394) Improve data locality documentation for Capacity Scheduler
Date Wed, 06 Jun 2018 13:14:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Weiwei Yang updated YARN-8394:
------------------------------
    Attachment: YARN-8394.001.patch

> Improve data locality documentation for Capacity Scheduler
> ----------------------------------------------------------
>
>                 Key: YARN-8394
>                 URL: https://issues.apache.org/jira/browse/YARN-8394
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>            Priority: Major
>         Attachments: YARN-8394.001.patch
>
>
> YARN-6344 introduces a new parameter {{yarn.scheduler.capacity.rack-locality-additional-delay}}
in capacity-scheduler.xml, we need to add some documentation in {{CapacityScheduler.md}} accordingly.
> Moreover, we are seeing more and more clusters are separating storage and computation
where file system is always remote, in such cases we need to introduce how to compromise data
locality in CS otherwise MR jobs are suffering.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message