hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nishanth S <chinchu2...@gmail.com>
Subject Re: Help with Kerberos
Date Tue, 05 May 2015 22:33:20 GMT
Thanks Chris.I checked  the  configuration files and see that these
properties are in place.I am trying to  connect to  hadoop cluster in linux
from a windows machine.




On Tue, May 5, 2015 at 1:25 PM, Chris Nauroth <cnauroth@hortonworks.com>
wrote:

> Hello Nishanth,
>
> The job submission was unable to identify the principal to use for renewal
> of HDFS delegation tokens.  Delegation tokens are subject to a soft
> expiration, which can be extended by a renewer requesting an extension
> from the NameNode periodically.  In the context of MapReduce running on
> YARN, the ResourceManager acts as the delegation token renewer.
>
> Specifically, this exception likely indicates that your configuration is
> missing either (or both) of the properties yarn.resourcemanager.address
> and yarn.resourcemanager.principal.
>
>   <property>
>     <description>The address of the applications manager interface in the
> RM.</description>
>     <name>yarn.resourcemanager.address</name>
>     <value>${yarn.resourcemanager.hostname}:8032</value>
>   </property>
>
>   <property>
>     <description>The Kerberos principal for the resource
> manager.</description>
>     <name>yarn.resourcemanager.principal</name>
>   </property>
>
> You might want to review the secure mode documentation.  It has more
> details on this and other relevant configuration properties.
>
> http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Secu
> reMode.html
>
> I hope this helps.
>
> --Chris Nauroth
>
>
> From:  Nishanth S <chinchu2884@gmail.com>
> Reply-To:  "user@hadoop.apache.org" <user@hadoop.apache.org>
> Date:  Tuesday, May 5, 2015 at 12:09 PM
> To:  "user@hadoop.apache.org" <user@hadoop.apache.org>
> Subject:  Help with Kerberos
>
>
> Hello ,
>
> I am getting the  below exception when trying to run a simple map reduce
> from a machine outside the  hadoop cluster.This is the kerberos code  I am
> using.Please help
>
>
> org.apache.hadoop.conf.Configuration conf = new
> org.apache.hadoop.conf.Configuration();
> conf.set("hadoop.security.authentication", "Kerberos");
> UserGroupInformation.setConfiguration(conf);
> try{
> UserGroupInformation.loginUserFromKeytab("abc@domain.com",
> "C:\\work\\documents\\devkeytab\\abc.keytab");
>
>
>
> Exception in thread "main" java.io.IOException: Can't get Master Kerberos
> principal for use as renewer
> at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInt
> ernal(TokenCache.java:116)
> at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInt
> ernal(TokenCache.java:100)
> at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(To
> kenCache.java:80)
> at
> org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(Fi
> leOutputFormat.java:142)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:562)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.jav
> a:432)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Unknown Source)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.j
> ava:1628)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1314)
>
>

Mime
View raw message