nemo-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jeongy...@apache.org
Subject [incubator-nemo] 06/40: add slot to source locality aware policy
Date Fri, 06 Apr 2018 02:35:46 GMT
This is an automated email from the ASF dual-hosted git repository.

jeongyoon pushed a commit to branch skew_exp
in repository https://gitbox.apache.org/repos/asf/incubator-nemo.git

commit 2825151eb7796b77add73325cf07b4c1e178a99a
Author: sanha <sanhaleehana@naver.com>
AuthorDate: Mon Mar 5 23:58:45 2018 +0900

    add slot to source locality aware policy
---
 .../runtime/master/scheduler/SourceLocationAwareSchedulingPolicy.java  | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/runtime/master/src/main/java/edu/snu/nemo/runtime/master/scheduler/SourceLocationAwareSchedulingPolicy.java
b/runtime/master/src/main/java/edu/snu/nemo/runtime/master/scheduler/SourceLocationAwareSchedulingPolicy.java
index 063d9bd..da8f5f7 100644
--- a/runtime/master/src/main/java/edu/snu/nemo/runtime/master/scheduler/SourceLocationAwareSchedulingPolicy.java
+++ b/runtime/master/src/main/java/edu/snu/nemo/runtime/master/scheduler/SourceLocationAwareSchedulingPolicy.java
@@ -153,7 +153,8 @@ public final class SourceLocationAwareSchedulingPolicy implements SchedulingPoli
       final String containerType, final Set<String> nodeNames) {
     final Stream<ExecutorRepresenter> localNodesWithSpareCapacity = executorRegistry.getRunningExecutorIds().stream()
         .map(executorId -> executorRegistry.getRunningExecutorRepresenter(executorId))
-        .filter(executor -> executor.getRunningTaskGroups().size() < executor.getExecutorCapacity())
+        .filter(executor -> executor.getRunningTaskGroups().size() - executor.getSmallTaskGroups().size()
+            < executor.getExecutorCapacity())
         .filter(executor -> nodeNames.contains(executor.getNodeName()));
     if (containerType.equals(ExecutorPlacementProperty.NONE)) {
       return localNodesWithSpareCapacity.collect(Collectors.toList());

-- 
To stop receiving notification emails like this one, please contact
jeongyoon@apache.org.

Mime
View raw message