flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ani.desh1512" <ani.desh1...@gmail.com>
Subject Re: Flink with Yarn on MapR
Date Wed, 25 Jan 2017 18:59:57 GMT


Following is the output when I execute *./bin/yarn-session.sh -n 2*


/2017-01-25 15:53:57,805 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.rpc.address, 10.101.2.111
2017-01-25 15:53:57,807 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.rpc.port, 6123
2017-01-25 15:53:57,807 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.heap.mb, 8192
2017-01-25 15:53:57,807 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.heap.mb, 40960
2017-01-25 15:53:57,807 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.numberOfTaskSlots, 5
2017-01-25 15:53:57,807 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.memory.preallocate, false
2017-01-25 15:53:57,808 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: parallelism.default, 1
2017-01-25 15:53:57,808 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.web.port, 8081
2017-01-25 15:53:57,808 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.tmp.dirs, /tmp/flink
2017-01-25 15:53:57,809 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: fs.hdfs.hadoopconf,
/opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop
2017-01-25 15:53:57,809 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: fs.default-scheme, maprfs:///
2017-01-25 15:53:57,839 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.rpc.address, 10.101.2.111
2017-01-25 15:53:57,839 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.rpc.port, 6123
2017-01-25 15:53:57,839 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.heap.mb, 8192
2017-01-25 15:53:57,839 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.heap.mb, 40960
2017-01-25 15:53:57,839 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.numberOfTaskSlots, 5
2017-01-25 15:53:57,839 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.memory.preallocate, false
2017-01-25 15:53:57,839 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: parallelism.default, 1
2017-01-25 15:53:57,840 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.web.port, 8081
2017-01-25 15:53:57,840 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.tmp.dirs, /tmp/flink
2017-01-25 15:53:57,841 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: fs.hdfs.hadoopconf,
/opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop
2017-01-25 15:53:57,841 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: fs.default-scheme, maprfs:///
2017-01-25 15:53:59,356 WARN  org.apache.hadoop.util.NativeCodeLoader                    
 
- Unable to load native-hadoop library for your platform... using
builtin-java classes where applicable
2017-01-25 15:53:59,628 INFO 
org.apache.flink.runtime.security.modules.HadoopModule        - Hadoop user
set to ubuntu (auth:SIMPLE)
2017-01-25 15:53:59,649 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.rpc.address, 10.101.2.111
2017-01-25 15:53:59,649 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.rpc.port, 6123
2017-01-25 15:53:59,650 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.heap.mb, 8192
2017-01-25 15:53:59,650 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.heap.mb, 40960
2017-01-25 15:53:59,650 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.numberOfTaskSlots, 5
2017-01-25 15:53:59,650 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.memory.preallocate, false
2017-01-25 15:53:59,650 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: parallelism.default, 1
2017-01-25 15:53:59,650 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: jobmanager.web.port, 8081
2017-01-25 15:53:59,651 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: taskmanager.tmp.dirs, /tmp/flink
2017-01-25 15:53:59,651 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: fs.hdfs.hadoopconf,
/opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop
2017-01-25 15:53:59,651 INFO 
org.apache.flink.configuration.GlobalConfiguration            - Loading
configuration property: fs.default-scheme, maprfs:///
Error while deploying YARN cluster: Couldn't deploy Yarn cluster
java.lang.RuntimeException: Couldn't deploy Yarn cluster
	at
org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:425)
	at
org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:620)
	at
org.apache.flink.yarn.cli.FlinkYarnSessionCli$1.call(FlinkYarnSessionCli.java:476)
	at
org.apache.flink.yarn.cli.FlinkYarnSessionCli$1.call(FlinkYarnSessionCli.java:473)
	at
org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
	at
org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
	at
org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:473)
Caused by: java.lang.NumberFormatException: For input string:
"${nodemanager.resource.cpu-vcores}"
	at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
	at java.lang.Integer.parseInt(Integer.java:481)
	at java.lang.Integer.parseInt(Integer.java:527)
	at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1271)
	at
org.apache.flink.yarn.AbstractYarnClusterDescriptor.isReadyForDeployment(AbstractYarnClusterDescriptor.java:315)
	at
org.apache.flink.yarn.AbstractYarnClusterDescriptor.deployInternal(AbstractYarnClusterDescriptor.java:434)
	at
org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:423)
	... 9 more/




--
View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Flink-with-Yarn-on-MapR-tp15448p15593.html
Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message