hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7494) Add muti node lookup support for better placement
Date Mon, 26 Mar 2018 07:11:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16413473#comment-16413473
] 

Weiwei Yang commented on YARN-7494:
-----------------------------------

Hi [~sunilg]

Another comment in \{{FiCaSchedulerApp}}

{code}

// Update multi-node sorting algorithm to scheduler envs

if (!appSchedulingInfo.getApplicationSchedulingEnvs().containsKey(
      ApplicationSchedulingConfig.ENV_MULTI_NODE_SORTING_POLICY)
     && getCSLeafQueue().getMultiNodeSortingAlgorithmName() != null) {
   appSchedulingInfo.getApplicationSchedulingEnvs().put(
       ApplicationSchedulingConfig.ENV_MULTI_NODE_SORTING_POLICY,
       getCSLeafQueue().getMultiNodeSortingAlgorithmName());
 }

{code}

getCSLeafQueue() did a cast to queue that assumes it is capacity scheduler, this is an incorrect
assumption in \{{FiCaSchedulerApp}}.  

> Add muti node lookup support for better placement
> -------------------------------------------------
>
>                 Key: YARN-7494
>                 URL: https://issues.apache.org/jira/browse/YARN-7494
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacity scheduler
>            Reporter: Sunil G
>            Assignee: Sunil G
>            Priority: Major
>         Attachments: YARN-7494.001.patch, YARN-7494.002.patch, YARN-7494.003.patch, YARN-7494.004.patch,
YARN-7494.v0.patch, YARN-7494.v1.patch, multi-node-designProposal.png
>
>
> Instead of single node, for effectiveness we can consider a multi node lookup based on
partition to start with.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message