pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang_intel (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-4131) Pig - kerberos error
Date Fri, 19 Sep 2014 00:31:33 GMT

     [ https://issues.apache.org/jira/browse/PIG-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

liyunzhang_intel updated PIG-4131:
----------------------------------
    Resolution: Duplicate
        Status: Resolved  (was: Patch Available)

duplicated with PIG-3507

> Pig - kerberos error
> --------------------
>
>                 Key: PIG-4131
>                 URL: https://issues.apache.org/jira/browse/PIG-4131
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.12.0
>         Environment: centos 6.5, cdh5.1.1
>            Reporter: narayana b
>            Assignee: liyunzhang_intel
>         Attachments: PIG_3507_1.patch
>
>
> Hi,
> I have running hadoop cluster
> The following steps are done and found an error.
> Is this core bug or something else?
> 1) I initialized my kerberos client( as Im using kerberos)
>     kinit cloudera/cloudera-cdh05.narayana.local@NARAYANA.LOCAL
> 2) pig -x local
> 3) A = load '/etc/passwd' using PigStorage(':');
> 4) B = foreach A generate $0 as id;
> 5) dump B;
>  
> Error
> ------
> 2014-08-18 00:04:29,074 [main] INFO  org.apache.pig.tools.pigstats.ScriptState - Pig
features used in the script: UNKNOWN
> 2014-08-18 00:04:29,149 [main] INFO  org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer
- {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, DuplicateForEachColumnRewrite, GroupByConstParallelSetter,
ImplicitSplitInserter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, NewPartitionFilterOptimizer,
PartitionFilterOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter],
RULES_DISABLED=[FilterLogicExpressionSimplifier]}
> 2014-08-18 00:04:29,201 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 6000: Output
Location Validation Failed for: 'file:/tmp/temp805769141/tmp-904818707 More info to follow:
> Can't get Master Kerberos principal for use as renewer
> Details at logfile: /usr/bin/pig_1408300456319.log
> grunt> quit
> [root@cloudera-cdh05 bin]# tail -100f /usr/bin/pig_1408300456319.log
>  
> Pig Stack Trace
> --------------------
> ERROR 6000: Output Location Validation Failed for: 'file:/tmp/temp805769141/tmp-
>     904818707 More info to follow:
>     Can't get Master Kerberos principal for use as renewer
>     org.apache.pig.impl.logicalLayer.FrontendException
>     : ERROR 1066: Unable to open iterator for alias B
>         at org.apache.pig.PigServer.openIterator(PigServer.java:880)
>         at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:774)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:372)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
>         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
>         at org.apache.pig.Main.run(Main.java:541)
>         at org.apache.pig.Main.main(Main.java:156)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>     Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias B
>         at org.apache.pig.PigServer.storeEx(PigServer.java:982)
>         at org.apache.pig.PigServer.store(PigServer.java:942)
>         at org.apache.pig.PigServer.openIterator(PigServer.java:855)
>         ... 12 more
>     Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 6000: Output Location
Validation Failed for: 'file:/tmp/temp805769141/tmp-904818707 More info to follow:
>     Can't get Master Kerberos principal for use as renewer
>         at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$InputOutputFileVisitor.visit(InputOutputFileValidator.java:95)
>         at org.apache.pig.newplan.logical.relational.LOStore.accept(LOStore.java:66)
>         at org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:64)
>         at org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
>         at org.apache.pig.newplan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:66)
>         at org.apache.pig.newplan.DepthFirstWalker.walk(DepthFirstWalker.java:53)
>         at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
>         at org.apache.pig.newplan.logical.rules.InputOutputFileValidator.validate(InputOutputFileValidator.java:45)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:303)
>         at org.apache.pig.PigServer.compilePp(PigServer.java:1380)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1305)
>         at org.apache.pig.PigServer.storeEx(PigServer.java:978)
>         ... 14 more
>     Caused by: java.io.IOException: Can't get Master Kerberos principal for use as renewer
>         at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:116)
>         at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
>         at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
>         at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:142)
>         at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$InputOutputFileVisitor.visit(InputOutputFileValidator.java:80)
>         ... 25 more
>     ================================================================================



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message