flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Federico D'Ambrosio" <fedex...@gmail.com>
Subject Re: Flink session on yarn
Date Mon, 20 Nov 2017 13:10:42 GMT
Hi Nishu,

did you compile Flink from sources as recommended here [1]?

Regards,
Federico

[1] https://ci.apache.org/projects/flink/flink-docs-
release-1.3/setup/building.html#vendor-specific-versions

2017-11-20 13:53 GMT+01:00 Nishu <nishutayal@gmail.com>:

> Hi,
>
> I am trying to start flink session(v1.3.2) on yarn(v 2.7) on HDInsight
> cluster.  But it throws following error:
>
> *Error while deploying YARN cluster: Couldn't deploy Yarn cluster*
> *java.lang.RuntimeException: Couldn't deploy Yarn cluster*
> *        at
> org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:443)*
> *        at
> org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:630)*
> *        at
> org.apache.flink.yarn.cli.FlinkYarnSessionCli$1.call(FlinkYarnSessionCli.java:486)*
> *        at
> org.apache.flink.yarn.cli.FlinkYarnSessionCli$1.call(FlinkYarnSessionCli.java:483)*
> *        at
> org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)*
> *        at java.security.AccessController.doPrivileged(Native Method)*
> *        at javax.security.auth.Subject.doAs(Subject.java:422)*
> *        at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)*
> *        at
> org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)*
> *        at
> org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:483)*
> *Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.ClassNotFoundException: Class
> org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider not
> found*
> *        at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2227)*
> *        at
> org.apache.hadoop.yarn.client.RMProxy.createRMFailoverProxyProvider(RMProxy.java:161)*
> *        at
> org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:94)*
> *        at
> org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:72)*
>
>
> I referred this mail thread also: http://apache-flink-
> user-mailing-list-archive.2336050.n4.nabble.com/Flink-session-on-Yarn-
> ClassNotFoundException-td15222.html
>
> I am using HDInsight Cluster(HDP3.6).   According to the documentation,
> set HADOOP_CONF_DIR and YARN_CONF_DIR as well.
>
> Any inputs will be really helpful. Thanks!
>
> --
> Thanks & Regards,
> Nishu Tayal
>



-- 
Federico D'Ambrosio

Mime
View raw message