From user-return-17919-archive-asf-public=cust-asf.ponee.io@flink.apache.org Wed Jan 31 16:11:28 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 66D35180662 for ; Wed, 31 Jan 2018 16:11:28 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 564F7160C35; Wed, 31 Jan 2018 15:11:28 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A6846160C25 for ; Wed, 31 Jan 2018 16:11:27 +0100 (CET) Received: (qmail 57430 invoked by uid 500); 31 Jan 2018 15:11:26 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 57421 invoked by uid 99); 31 Jan 2018 15:11:26 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 Jan 2018 15:11:26 +0000 Received: from [192.168.178.63] (ip-2-205-86-231.web.vodafone.de [2.205.86.231]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id B6CC71A00D0 for ; Wed, 31 Jan 2018 15:11:25 +0000 (UTC) Subject: Re: How to access JobManager and TaskManager To: user@flink.apache.org References: <1517381460374-0.post@n4.nabble.com> From: Timo Walther Message-ID: <177bbc61-6e3f-a05a-c2bd-b43dc0a8846c@apache.org> Date: Wed, 31 Jan 2018 16:11:23 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 MIME-Version: 1.0 In-Reply-To: <1517381460374-0.post@n4.nabble.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit I don't have this property in my local running Flink cluster. Which Flink version and deployment are you using? Are you sure this property is not set in your flink-conf.yaml? Regards, Timo Am 1/31/18 um 7:51 AM schrieb xiatao123: > In the web UI, I can see these information under JobManager. How can I access > variables job_env in main method? > > Job Manager > Configuration > env.hadoop.conf.dir /etc/hadoop/conf > env.yarn.conf.dir /etc/hadoop/conf > high-availability.cluster-id application_1517362137681_0001 > job_env stage > jobmanager.rpc.address ip-172-32-37-243.us-west-2.compute.internal > jobmanager.rpc.port 46253 > jobmanager.web.port 0 > taskmanager.numberOfTaskSlots 4 > > When Task Manager starts, I also noticed the same setting "job_env" is > loaded in GlobalConfiguration. > > 2018-01-31 01:34:54,970 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: env.yarn.conf.dir, /etc/hadoop/conf > 2018-01-31 01:34:54,976 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: taskmanager.maxRegistrationDuration, 5 minutes > 2018-01-31 01:34:54,979 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: high-availability.cluster-id, > application_1517362137681_0001 > 2018-01-31 01:34:54,979 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: env.hadoop.conf.dir, /etc/hadoop/conf > 2018-01-31 01:34:54,979 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: taskmanager.numberOfTaskSlots, 4 > 2018-01-31 01:34:54,982 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: jobmanager.rpc.address, > ip-172-32-37-243.us-west-2.compute.internal > 2018-01-31 01:34:54,982 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: job_env, stage > 2018-01-31 01:34:54,982 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: jobmanager.web.port, 0 > 2018-01-31 01:34:54,983 INFO > org.apache.flink.configuration.GlobalConfiguration - Loading > configuration property: jobmanager.rpc.port, 46253 > > BUT, when I try to access or print out all the variables in my main method > val configs = GlobalConfiguration.loadConfiguration().toMap > for ((k,v) <- configs) println(s"Configs key: $k, value: $v") > I only got these 3: > Configs key: env.hadoop.conf.dir, value: /etc/hadoop/conf > Configs key: taskmanager.numberOfTaskSlots, value: 4 > Configs key: env.yarn.conf.dir, value: /etc/hadoop/conf > > anyone can help? > > > > -- > Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/