pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-740) Incorrect line number is generated when a string with double quotes is used instead of single quotes and is passed to UDF
Date Thu, 29 Apr 2010 21:26:54 GMT

     [ https://issues.apache.org/jira/browse/PIG-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pradeep Kamath updated PIG-740:
-------------------------------

    Attachment: PIG-740.patch

GruntParser was not handling double quotes within foreach blocks correctly by incorrectly
treating them the same way as single quote for the starting double quote and not handling
the end double quote - the patch addresses the bug by treating double quotes correctly.

> Incorrect line number is generated when a string  with double quotes is used instead
of single quotes and is passed to UDF
> --------------------------------------------------------------------------------------------------------------------------
>
>                 Key: PIG-740
>                 URL: https://issues.apache.org/jira/browse/PIG-740
>             Project: Pig
>          Issue Type: Bug
>          Components: grunt
>    Affects Versions: 0.3.0
>            Reporter: Viraj Bhat
>            Priority: Minor
>         Attachments: PIG-740.patch
>
>
> Consider the Pig script with the error that a String with double quotes {code}"www\\."{code}
is used instead of a single quote {code}'www\\.'{code} in the UDF string.REPLACEALL()
> {code}
> register string-2.0.jar;
> A = load 'inputdata' using PigStorage() as ( curr_searchQuery );
> B = foreach A {
>         domain = string.REPLACEALL(curr_searchQuery,"^www\\.",'');
>         generate
>         domain;
>         };
> dump B;
> {code}
> I get the following error message where "Line 11" points to the end of file. The error
message should point to "Line 5".
> ===================================================================================================================================
> 2009-03-31 01:33:38,403 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
- Connecting to hadoop file system at: hdfs://localhost:9000
> 2009-03-31 01:33:39,168 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
- Connecting to map-reduce job tracker at: localhost:9001
> 2009-03-31 01:33:39,589 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1000: Error
during parsing. Lexical error at line 11, column 0.  Encountered: <EOF> after : ""
> Details at logfile: /home/viraj/pig-svn/trunk/pig_1238463218046.log
> ===================================================================================================================================
> The log file contains the following contents
> ===================================================================================================================================
> ERROR 1000: Error during parsing. Lexical error at line 11, column 0.  Encountered: <EOF>
after : ""
> org.apache.pig.tools.pigscript.parser.TokenMgrError: Lexical error at line 11, column
0.  Encountered: <EOF> after : ""
>         at org.apache.pig.tools.pigscript.parser.PigScriptParserTokenManager.getNextToken(PigScriptParserTokenManager.java:2739)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.jj_ntk(PigScriptParser.java:778)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:89)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:99)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:88)
>         at org.apache.pig.Main.main(Main.java:352)
> ===================================================================================================================================

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message