hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harry Y (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-212) Grunt aborts frequently on script errors.
Date Fri, 18 Apr 2008 23:10:22 GMT

    [ https://issues.apache.org/jira/browse/PIG-212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12590643#action_12590643

Harry Y commented on PIG-212:

I'm very new to Pig, and I encounter this type of problem quite frequently. I haven't really
looked at the code, but it appears that the Pig processor and the shell is not cleanly separated.
When errors like TokenMgrError (which I presume a runtime error rather than an exception from
the name) is thrown, there might not be much the Pig prcessor can do and it may be reasonable
to just bail out. However, the grunt shell should be able to catch this type of non-fatal
errors ("non-fatal" as far as Grunt is concerned) rather than just crash. I could be completely
off here, but I suspect that this can be easily fixed by slightly modifying the high-level
logic (e.g., regarding how grunt calls/spawns the pig "module", if there is such a thing).

> Grunt aborts frequently on script errors.
> -----------------------------------------
>                 Key: PIG-212
>                 URL: https://issues.apache.org/jira/browse/PIG-212
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Amir Youssefi
>            Priority: Minor
> Grunt aborts frequently on many errors e.g. Lexical error below. Then users have to wait
in queue to get nodes again. Assigning low priority.
> grunt> store Aa0 into 'test-data-20080415-001-Aa0' using PigStore(" ");
> org.apache.pig.impl.logicalLayer.parser.TokenMgrError: Lexical error at line 1, column
60.  Encountered: "\"" (34), after : ""
>         at org.apache.pig.impl.logicalLayer.parser.QueryParserTokenManager.getNextToken(QueryParserTokenManager.java:1606)
>         at org.apache.pig.impl.logicalLayer.parser.QueryParser.jj_ntk(QueryParser.java:4269)
>         at org.apache.pig.impl.logicalLayer.parser.QueryParser.StringList(QueryParser.java:706)
>         at org.apache.pig.impl.logicalLayer.parser.QueryParser.StoreClause(QueryParser.java:3246)
>         at org.apache.pig.impl.logicalLayer.parser.QueryParser.BaseExpr(QueryParser.java:595)
>         at org.apache.pig.impl.logicalLayer.parser.QueryParser.Expr(QueryParser.java:378)
>         at org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:248)
>         at org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:47)
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:240)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:459)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:226)
>         at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:73)
>         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:54)
>         at org.apache.pig.Main.main(Main.java:253)
> 2008-04-17 23:35:46,946 [Thread-0] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
- Disconnecting from HOD...
> $

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message