flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Till Rohrmann (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-7866) Weigh list of preferred locations for scheduling
Date Wed, 18 Oct 2017 09:14:02 GMT

     [ https://issues.apache.org/jira/browse/FLINK-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Till Rohrmann updated FLINK-7866:
---------------------------------
    Description: 
[~sihuazhou] proposed to not only use the list of preferred locations to decide where to schedule
a task, but to also weigh the list according to how often a location appeared and then select
the location based on the weight. That way, we would obtain better locality in some cases.

Example:

Preferred locations list: {{ [location1, location2, location2] }}
Weighted preferred locations list {{ [(location2 , 2), (location1, 1)] }}

  was:
[~sihuazhou] proposed to not only use the list of preferred locations to decide where to schedule
a task, but to also weigh the list according to how often a location appeared and then select
the location based on the weight. That way, we would obtain better locality in some cases.

Example:

Preferred locations list: {{ {location1, location2, location2} }}
Weighted preferred locations list {{ {(location2 , 2), (location1, 1)} }}


> Weigh list of preferred locations for scheduling
> ------------------------------------------------
>
>                 Key: FLINK-7866
>                 URL: https://issues.apache.org/jira/browse/FLINK-7866
>             Project: Flink
>          Issue Type: Improvement
>          Components: Scheduler
>    Affects Versions: 1.4.0, 1.3.2
>            Reporter: Till Rohrmann
>             Fix For: 1.5.0
>
>
> [~sihuazhou] proposed to not only use the list of preferred locations to decide where
to schedule a task, but to also weigh the list according to how often a location appeared
and then select the location based on the weight. That way, we would obtain better locality
in some cases.
> Example:
> Preferred locations list: {{ [location1, location2, location2] }}
> Weighted preferred locations list {{ [(location2 , 2), (location1, 1)] }}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message