Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 0CF1F200C6A for ; Thu, 30 Mar 2017 04:10:46 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0B963160B9D; Thu, 30 Mar 2017 02:10:46 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 57DCD160BA1 for ; Thu, 30 Mar 2017 04:10:45 +0200 (CEST) Received: (qmail 30478 invoked by uid 500); 30 Mar 2017 02:10:44 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 30455 invoked by uid 99); 30 Mar 2017 02:10:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Mar 2017 02:10:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 02ABC1A02FF for ; Thu, 30 Mar 2017 02:10:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Ptx9vOxkx-Gr for ; Thu, 30 Mar 2017 02:10:43 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id A1AC95F29B for ; Thu, 30 Mar 2017 02:10:42 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id E65E1E002F for ; Thu, 30 Mar 2017 02:10:41 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id A2A952416C for ; Thu, 30 Mar 2017 02:10:41 +0000 (UTC) Date: Thu, 30 Mar 2017 02:10:41 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-5903) taskmanager.numberOfTaskSlots and yarn.containers.vcores did not work well in YARN mode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 30 Mar 2017 02:10:46 -0000 [ https://issues.apache.org/jira/browse/FLINK-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948276#comment-15948276 ] ASF GitHub Bot commented on FLINK-5903: --------------------------------------- Github user WangTaoTheTonic commented on the issue: https://github.com/apache/flink/pull/3408 @tillrohrmann After changing code the test results(both session and single mode) is like: | Configurations | #vcores of container(TM) | #slots of TM | | ---------------------------------------- | ------------------------ | ------------ | | -s/-ys 5, yarn.containers.vcores: 4, taskmanager.numberOfTaskSlots: 3 | 4 | 5 | | yarn.containers.vcores: 4, taskmanager.numberOfTaskSlots: 3 | 4 | 3 | | yarn.containers.vcores: 4 | 4 | 1 | | -s/-ys 5, taskmanager.numberOfTaskSlots: 3 | 5 | 5 | | taskmanager.numberOfTaskSlots: 3 | 3 | 3 | | Nothing to specify, all use default | 1 | 1 | Please check :) > taskmanager.numberOfTaskSlots and yarn.containers.vcores did not work well in YARN mode > --------------------------------------------------------------------------------------- > > Key: FLINK-5903 > URL: https://issues.apache.org/jira/browse/FLINK-5903 > Project: Flink > Issue Type: Sub-task > Components: YARN > Reporter: Tao Wang > Assignee: Tao Wang > Attachments: set taskmanager.numberOfTaskSlots to 6.JPG, set yarn.container.vcores to 5_JM.JPG, set yarn.container.vcores to 5_RM.JPG > > > Now Flink did not respect taskmanager.numberOfTaskSlots and yarn.containers.vcores in flink-conf.yaml, but only -s parameter in CLI. > Details is that taskmanager.numberOfTaskSlots is not working in anyway andyarn.containers.vcores is only used in requesting container(TM) resources but not aware to TM, which means TM will always think it has default(1) Slots if -s is not configured. -- This message was sent by Atlassian JIRA (v6.3.15#6346)