flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kostas Tzoumas <ktzou...@apache.org>
Subject Fwd: MODERATE for dev@flink.apache.org
Date Tue, 27 Jan 2015 05:25:13 GMT
I am forwarding this as I could not approve it for some reason.

Kostas


---------- Forwarded message ----------
From: Ankit Jhalaria <ankit13@yahoo-inc.com.invalid>
To: "dev@flink.apache.org" <dev@flink.apache.org>
Cc:
Date: Mon, 26 Jan 2015 22:59:53 +0000 (UTC)
Subject: [Flink reading HDFS] : SIMPLE authentication is not enabled.
Available:[TOKEN, KERBEROS]
Hey guys,

I am trying to setup a Flink cluster that can read from a Hadoop Cluster.
We have a total of 8 machines on the Flink cluster and on all those
machines can access HDFS on the Hadoop cluster.

Flink Version : flink-0.9-SNAPSHOT
Hadoop 2.5.0.8.1411070359

When I try to run a program that reads from HDFS, I get the following error
[Stack Trace shown below]. How do i enable flink to use kerberos
authentication? Any clues would be appreciated. Tried sending emails
earlier to *issues*@flink.apache.org. Got a bounce back email everytime.

*Caused by:
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
SIMPLE authentication is not enabled.  Available:[TOKEN, KERBEROS]*
at org.apache.hadoop.ipc.Client.call(Client.java:1347)
at org.apache.hadoop.ipc.Client.call(Client.java:1300)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:651)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1679)

Thanks,
Ankit

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message