flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ankit Jhalaria <anki...@yahoo-inc.com.INVALID>
Subject Re: MODERATE for dev@flink.apache.org
Date Wed, 28 Jan 2015 23:41:43 GMT
Thanks Robert. I am working for the Ads & Data team at Yahoo and we were experimenting
with flink. Without kerberos, we cannot talk to hdfs. Would you have a timeline as to when
kerberos support will be added to flink?
Thanks,Ankit 

     On Tuesday, January 27, 2015 2:49 AM, Robert Metzger <rmetzger@apache.org> wrote:
   

 Hey Ankit,
sorry for the issues with the mailing lists.Its our fault that we didn't properly mark the
issues@ list as a read-only mailing list on our website. I've updated the website to make
it more clear: http://flink.apache.org/community.html#mailing-lists
Regarding the problem you've reported: Are you using Flink with YARN or do you have it installed
directly on the cluster?Either way, Flink doesn't have support for secure Hadoop environments
right now. I'll make adding security support for Flink on YARN a top priority now.

Best,Robert


On Tue, Jan 27, 2015 at 6:43 AM, Henry Saputra <henry.saputra@gmail.com> wrote:

Ankit,

Please subscribe to dev@ list by sending email to
dev-subscribe@flink.apache.org [1]

[1] http://flink.apache.org/community.html#mailing-lists

On Mon, Jan 26, 2015 at 9:25 PM, Kostas Tzoumas <ktzoumas@apache.org> wrote:
> I am forwarding this as I could not approve it for some reason.
>
> Kostas
>
>
> ---------- Forwarded message ----------
> From: Ankit Jhalaria <ankit13@yahoo-inc.com.invalid>
> To: "dev@flink.apache.org" <dev@flink.apache.org>
> Cc:
> Date: Mon, 26 Jan 2015 22:59:53 +0000 (UTC)
> Subject: [Flink reading HDFS] : SIMPLE authentication is not enabled.
> Available:[TOKEN, KERBEROS]
> Hey guys,
>
> I am trying to setup a Flink cluster that can read from a Hadoop Cluster.
> We have a total of 8 machines on the Flink cluster and on all those
> machines can access HDFS on the Hadoop cluster.
>
> Flink Version : flink-0.9-SNAPSHOT
> Hadoop 2.5.0.8.1411070359
>
> When I try to run a program that reads from HDFS, I get the following error
> [Stack Trace shown below]. How do i enable flink to use kerberos
> authentication? Any clues would be appreciated. Tried sending emails
> earlier to *issues*@flink.apache.org. Got a bounce back email everytime.
>
> *Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
> SIMPLE authentication is not enabled.  Available:[TOKEN, KERBEROS]*
> at org.apache.hadoop.ipc.Client.call(Client.java:1347)
> at org.apache.hadoop.ipc.Client.call(Client.java:1300)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
> at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
> at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:651)
> at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1679)
>
> Thanks,
> Ankit




   
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message