Mailing-List: contact issues-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
Date: Wed, 12 Jul 2017 16:17:00 +0000 (UTC)
From: =?utf-8?Q?=E5=88=98=E5=96=86_=28JIRA=29?= <jira@apache.org>
To: issues@flink.apache.org
Message-ID: <JIRA.13086534.1499853382000.229908.1499876220151@Atlassian.JIRA>
In-Reply-To: <JIRA.13086534.1499853382000@Atlassian.JIRA>
References: <JIRA.13086534.1499853382000@Atlassian.JIRA> <JIRA.13086534.1499853382676@jira-lw-us.apache.org>
Subject: [jira] [Commented] (FLINK-7165) Flink can't deploy on hadoop
 2.6.0-cdh5.5.1 yarn
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Wed, 12 Jul 2017 16:17:04 -0000


    [ https://issues.apache.org/jira/browse/FLINK-7165?page=3Dcom.atlassian=
.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1608=
4246#comment-16084246 ]=20

=E5=88=98=E5=96=86 commented on FLINK-7165:
---------------------------

I have tried the following approaches:
#  Try the Flink for Hadoop 2.6.x,  I got the same error
#  Build from source with hadoop 2.6.0-cdh5.5.1, I got the same error
#  try to using the hadoop jars,  but other classes error


> Flink can't deploy on hadoop 2.6.0-cdh5.5.1 yarn
> ------------------------------------------------
>
>                 Key: FLINK-7165
>                 URL: https://issues.apache.org/jira/browse/FLINK-7165
>             Project: Flink
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.3.1, 1.4.0
>         Environment: Flink 1.3.1 and Flink 1.4-SNAPSHOT
> hadoop 2.6.0-cdh5.5.1
>            Reporter: =E5=88=98=E5=96=86
>
> When run with :=20
> {quote}
>  HADOOP_CONF_DIR=3D/etc/hadoop/conf ./bin/flink run -m yarn-cluster  -yn =
300 -yjm 4192 -ytm 1124 -c fTest.StreamingJob -p 300 ./fT.jar
> {quote}
> It failed.
> Logs as below:
> {quote}
> 2017-07-12 17:49:44.774 [main] INFO  org.apache.flink.yarn.YarnApplicatio=
nMasterRunner  - TM:remote keytab principal obtained null
> 2017-07-12 17:49:44.774 [main] INFO  org.apache.flink.yarn.YarnApplicatio=
nMasterRunner  - TM:remote yarn conf path obtained null
> 2017-07-12 17:49:44.774 [main] INFO  org.apache.flink.yarn.YarnApplicatio=
nMasterRunner  - TM:remote krb5 path obtained null
> 2017-07-12 17:49:44.986 [main] ERROR org.apache.flink.yarn.YarnApplicatio=
nMasterRunner  - YARN Application Master initialization failed
> java.lang.AbstractMethodError: org.apache.hadoop.hdfs.server.namenode.ha.=
ConfiguredFailoverProxyProvider.getProxy()Ljava/lang/Object;
>         at org.apache.hadoop.io.retry.RetryInvocationHandler.<init>(Retry=
InvocationHandler.java:73) ~[fT.jar:na]
>         at org.apache.hadoop.io.retry.RetryInvocationHandler.<init>(Retry=
InvocationHandler.java:64) ~[fT.jar:na]
>         at org.apache.hadoop.io.retry.RetryProxy.create(RetryProxy.java:5=
8) ~[fT.jar:na]
>         at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodePro=
xies.java:183) ~[flink-shaded-hadoop2-uber-1.4-SNAPSHOT.jar:1.4-SNAPSHOT]
>         at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:665) ~[=
flink-shaded-hadoop2-uber-1.4-SNAPSHOT.jar:1.4-SNAPSHOT]
>         at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:601) ~[=
flink-shaded-hadoop2-uber-1.4-SNAPSHOT.jar:1.4-SNAPSHOT]
>         at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(Distri=
butedFileSystem.java:148) ~[flink-shaded-hadoop2-uber-1.4-SNAPSHOT.jar:1.4-=
SNAPSHOT]
>         at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.ja=
va:2316) ~[fT.jar:na]
>         at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:90)=
 ~[fT.jar:na]
>         at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.j=
ava:2350) ~[fT.jar:na]
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2332=
) ~[fT.jar:na]
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:369) ~[fT.=
jar:na]
>         at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296) ~[fT.ja=
r:na]
>         at org.apache.flink.yarn.Utils.createTaskExecutorContext(Utils.ja=
va:380) ~[flink-dist_2.11-1.4-SNAPSHOT.jar:1.4-SNAPSHOT]
>         at org.apache.flink.yarn.YarnApplicationMasterRunner.runApplicati=
onMaster(YarnApplicationMasterRunner.java:318) [flink-dist_2.11-1.4-SNAPSHO=
T.jar:1.4-SNAPSHOT]
>         at org.apache.flink.yarn.YarnApplicationMasterRunner$1.call(YarnA=
pplicationMasterRunner.java:191) [flink-dist_2.11-1.4-SNAPSHOT.jar:1.4-SNAP=
SHOT]
>         at org.apache.flink.yarn.YarnApplicationMasterRunner$1.call(YarnA=
pplicationMasterRunner.java:188) [flink-dist_2.11-1.4-SNAPSHOT.jar:1.4-SNAP=
SHOT]
>         at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(=
HadoopSecurityContext.java:44) [flink-dist_2.11-1.4-SNAPSHOT.jar:1.4-SNAPSH=
OT]
>         at java.security.AccessController.doPrivileged(Native Method) [na=
:1.8.0_112]
>         at javax.security.auth.Subject.doAs(Subject.java:422) [na:1.8.0_1=
12]
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroup=
Information.java:1548) [fT.jar:na]
>         at org.apache.flink.runtime.security.HadoopSecurityContext.runSec=
ured(HadoopSecurityContext.java:41) [flink-dist_2.11-1.4-SNAPSHOT.jar:1.4-S=
NAPSHOT]
>         at org.apache.flink.yarn.YarnApplicationMasterRunner.run(YarnAppl=
icationMasterRunner.java:188) [flink-dist_2.11-1.4-SNAPSHOT.jar:1.4-SNAPSHO=
T]
>         at org.apache.flink.yarn.YarnApplicationMasterRunner.main(YarnApp=
licationMasterRunner.java:112) [flink-dist_2.11-1.4-SNAPSHOT.jar:1.4-SNAPSH=
OT]
> {quote}


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)