flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <trohrm...@apache.org>
Subject Re: Flink using Yarn on MapR
Date Fri, 11 Nov 2016 13:51:38 GMT
Hi Naveen,

I could reproduce your problem with the given Hadoop version
(2.7.0-mapr-1607). It seems to me as if this version always tries to use
Kerberos even though I selected the AuthenticationMethod.SIMPLE (no
Kerberos activated). I've also tested it with vanilla Hadoop 2.7.3 and
there it works. Can it be a peculiarity of this MapR Hadoop version? Can
you use the vanilla version or configure Kerberos?

I've pulled in Max who is more involved in Flink's security feature. Maybe
he can tell you a little bit more.

But in any case, the security feature should never interfere with the
normal execution if not activated. This looks like a bug to me. I've filed
a JIRA issue for that [1].

Concerning the MapR filesystem scheme where does flink complain about it?
Maybe you have to specify the proper "maprfs:" scheme when specifying paths?

[1] https://issues.apache.org/jira/browse/FLINK-5055

Cheers,
Till

On Fri, Nov 11, 2016 at 7:36 AM, Naveen Tirupattur <ntirupattur@maprtech.com
> wrote:

> Hi,
>
> I am trying to setup flink with yarn on MapR. I built flink using the
> following command and build finished successfully.
>
> mvn clean install -DskipTests -Pvendor-repos -Dhadoop.version=2.7.0-mapr-1607
> -Dhadoop.vendor=MapR
>
> Now when I try to start yarn session I am seeing the below error
>
> 2016-11-10 16:03:07,795 DEBUG org.apache.flink.runtime.security.JaasConfiguration
>          - JAAS configuration requested for the application entry:
> hadoop_simple
> Debug is  true storeKey false useTicketCache true useKeyTab false
> doNotPrompt true ticketCache is null isInitiator true KeyTab is null
> refreshKrb5Config is false principal is null tryFirstPass is false
> useFirstPass is false storePass is false clearPass is false
> Acquire TGT from Cache
> >>>KinitOptions cache name is /tmp/krb5cc_0
> Principal is null
> null credentials from Ticket Cache
>                 [Krb5LoginModule] authentication failed
> Unable to obtain Principal Name for authentication
> 2016-11-10 16:03:07,803 DEBUG org.apache.hadoop.security.UserGroupInformation
>              - failure to login
> javax.security.auth.login.LoginException: Unable to obtain Principal Name
> for authentication
>         at com.sun.security.auth.module.Krb5LoginModule.promptForName(
> Krb5LoginModule.java:841)
>         at com.sun.security.auth.module.Krb5LoginModule.
> attemptAuthentication(Krb5LoginModule.java:704)
>         at com.sun.security.auth.module.Krb5LoginModule.login(
> Krb5LoginModule.java:617)
>
> I am not sure why it is trying to use kerberos for authentication. The
> cluster is an unsecure cluster and I did not enable kerberos.
>
> I also tried running yarn session by directly downloading flink package
> for hadoop 2.7 on MapR and it complains the scheme is file. I could not
> figure out how to change it to MapR FS.
>
> Could you please help me on this.
>
> Thanks,
> Naveen

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message