flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9455) Make SlotManager aware of multi slot TaskManagers
Date Wed, 26 Sep 2018 15:31:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16628942#comment-16628942
] 

ASF GitHub Bot commented on FLINK-9455:
---------------------------------------

tillrohrmann commented on a change in pull request #6734: [FLINK-9455][RM] Add support for
multi task slot TaskExecutors
URL: https://github.com/apache/flink/pull/6734#discussion_r220613316
 
 

 ##########
 File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/ImmutablePendingSlotBalance.java
 ##########
 @@ -0,0 +1,46 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.resourcemanager.slotmanager;
+
+/**
+ * Immutable slot balance.
+ */
+final class ImmutablePendingSlotBalance extends PendingSlotBalance {
 
 Review comment:
   No a left-over from a previous implementation. Will remove it.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Make SlotManager aware of multi slot TaskManagers
> -------------------------------------------------
>
>                 Key: FLINK-9455
>                 URL: https://issues.apache.org/jira/browse/FLINK-9455
>             Project: Flink
>          Issue Type: Improvement
>          Components: Distributed Coordination, ResourceManager
>    Affects Versions: 1.5.0
>            Reporter: Till Rohrmann
>            Assignee: Till Rohrmann
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.7.0
>
>
> The {{SlotManager}} responsible for managing all available slots of a Flink cluster can
request to start new {{TaskManagers}} if it cannot fulfill a slot request. The started {{TaskManager}}
can be started with multiple slots configured but currently, the {{SlotManager}} thinks that
it will be started with a single slot. As a consequence, it might issue multiple requests
to start new TaskManagers even though a single one would be sufficient to fulfill all pending
slot requests.
> In order to avoid requesting unnecessary resources which are freed after the idle timeout,
I suggest to make the {{SlotManager}} aware of how many slots a {{TaskManager}} is started
with. That way the SlotManager only needs to request a new {{TaskManager}} if all of the previously
started slots (potentially not yet registered and, thus, future slots) are being assigned
to slot requests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message