incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajesh Balamohan <rajesh.balamo...@gmail.com>
Subject Re: HCatalog with Pig (Security)
Date Sat, 12 May 2012 00:20:00 GMT
Thanks Jakob. Looks like what you pointed out was the problem.

Thanks a bunch Jakob and David for helping on this.

~Rajesh.B

On Fri, May 11, 2012 at 10:55 PM, Jakob Homan <jghoman@gmail.com> wrote:

> Yes, you get that error when you're including the 0.20 jar rather than
> one with security.
>
> On Fri, May 11, 2012 at 3:07 AM, David Capwell <dcapwell@gmail.com> wrote:
> > 0.20.20x  what x are you using?  I Think that method was added in 204.
> >
> > On May 10, 2012 10:10 PM, "Rajesh Balamohan" <rajesh.balamohan@gmail.com
> >
> > wrote:
> >>
> >> Hi All,
> >>
> >> I am currently using the following configuration
> >>
> >> Pig 0.9.3
> >> Hadoop 0.20.20x (Kerb security enabled)
> >> Hcatalog 0.4.0
> >>
> >> I have disabled kerberos in HCatalog as its mainly for thrift
> connectivty.
> >> I am able to carry out simple load and dump operations. However, when I
> run
> >> "store" operation, it throws following error
> >>
> >> Any help/pointers would be much appreciated.
> >>
> >>
> >>
> >> ---------------
> >> ERROR 2998: Unhandled internal error.
> >>
> org.apache.hadoop.security.UserGroupInformation.login(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;
> >>
> >> java.lang.NoSuchMethodError:
> >>
> org.apache.hadoop.security.UserGroupInformation.login(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;
> >>         at
> >>
> org.apache.hadoop.hive.shims.Hadoop20Shims.getUGIForConf(Hadoop20Shims.java:495)
> >>         at
> org.apache.hadoop.hive.conf.HiveConf.getUser(HiveConf.java:918)
> >>         at
> >>
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDelegationToken(HiveMetaStoreClient.java:1129)
> >>         at
> >> org.apache.hcatalog.mapreduce.Security.handleSecurity(Security.java:121)
> >>         at
> >>
> org.apache.hcatalog.mapreduce.HCatOutputFormat.setOutput(HCatOutputFormat.java:191)
> >>         at
> >> org.apache.hcatalog.pig.HCatStorer.setStoreLocation(HCatStorer.java:105)
> >>         at
> >>
> org.apache.pig.newplan.logical.rules.InputOutputFileValidator$InputOutputFileVisitor.visit(InputOutputFileValidator.java:68)
> >>         at
> >>
> org.apache.pig.newplan.logical.relational.LOStore.accept(LOStore.java:77)
> >>         at
> >>
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:64)
> >>         at
> >>
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
> >>         at
> >>
> org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
> >>         at
> >> org.apache.pig.newplan.DepthFirstWalker.walk(DepthFirstWalker.java:53)
> >>         at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
> >>         at
> >>
> org.apache.pig.newplan.logical.rules.InputOutputFileValidator.validate(InputOutputFileValidator.java:45)
> >>         at
> >>
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:292)
> >>         at org.apache.pig.PigServer.compilePp(PigServer.java:1360)
> >>         at
> >> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1297)
> >>         at org.apache.pig.PigServer.execute(PigServer.java:1286)
> >>         at org.apache.pig.PigServer.executeBatch(PigServer.java:360)
> >>         at
> >>
> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131)
> >>         at
> >>
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192)
> >>         at
> >>
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> >>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> >>         at org.apache.pig.Main.run(Main.java:427)
> >>         at org.apache.pig.Main.main(Main.java:108)
> >>
> >>
> >> --
> >> ~Rajesh.B
>



-- 
~Rajesh.B

Mime
View raw message