incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajesh Balamohan <rajesh.balamo...@gmail.com>
Subject HCatalog with Pig (Security)
Date Fri, 11 May 2012 05:09:28 GMT
Hi All,

I am currently using the following configuration

Pig 0.9.3
Hadoop 0.20.20x (Kerb security enabled)
Hcatalog 0.4.0

I have disabled kerberos in HCatalog as its mainly for thrift connectivty.
I am able to carry out simple load and dump operations. However, when I run
"store" operation, it throws following error

Any help/pointers would be much appreciated.



---------------
ERROR 2998: Unhandled internal error.
org.apache.hadoop.security.UserGroupInformation.login(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;

java.lang.NoSuchMethodError:
org.apache.hadoop.security.UserGroupInformation.login(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;
        at
org.apache.hadoop.hive.shims.Hadoop20Shims.getUGIForConf(Hadoop20Shims.java:495)
        at org.apache.hadoop.hive.conf.HiveConf.getUser(HiveConf.java:918)
        at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDelegationToken(HiveMetaStoreClient.java:1129)
        at
org.apache.hcatalog.mapreduce.Security.handleSecurity(Security.java:121)
        at
org.apache.hcatalog.mapreduce.HCatOutputFormat.setOutput(HCatOutputFormat.java:191)
        at
org.apache.hcatalog.pig.HCatStorer.setStoreLocation(HCatStorer.java:105)
        at
org.apache.pig.newplan.logical.rules.InputOutputFileValidator$InputOutputFileVisitor.visit(InputOutputFileValidator.java:68)
        at
org.apache.pig.newplan.logical.relational.LOStore.accept(LOStore.java:77)
        at
org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:64)
        at
org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
        at
org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
        at
org.apache.pig.newplan.DepthFirstWalker.walk(DepthFirstWalker.java:53)
        at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
        at
org.apache.pig.newplan.logical.rules.InputOutputFileValidator.validate(InputOutputFileValidator.java:45)
        at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:292)
        at org.apache.pig.PigServer.compilePp(PigServer.java:1360)
        at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1297)
        at org.apache.pig.PigServer.execute(PigServer.java:1286)
        at org.apache.pig.PigServer.executeBatch(PigServer.java:360)
        at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131)
        at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192)
        at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
        at org.apache.pig.Main.run(Main.java:427)
        at org.apache.pig.Main.main(Main.java:108)


-- 
~Rajesh.B

Mime
View raw message