pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timothy Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2769) a simple logic causes very long compiling time on pig 0.10.0
Date Mon, 22 Oct 2012 17:36:14 GMT

    [ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13481538#comment-13481538
] 

Timothy Chen commented on PIG-2769:
-----------------------------------

I decided to leave this issue open to grab for now since this issue is mostly in the ANTLR
generated code and I am still learning about ANTLR.
It does seems that it's recursively calling foreach_complex_statement pretty excessively,
but I don't have enough knowledge to deduce the grammer so it still works.
I did verify that the AST generated in 0.9.2 and 0.10-SNAPSHOT generated is exactly the same
if that helps.
                
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
>                 Key: PIG-2769
>                 URL: https://issues.apache.org/jira/browse/PIG-2769
>             Project: Pig
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.10.0
>         Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
>            Reporter: Dan Li
>             Fix For: 0.12
>
>         Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0,
while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage()  AS (m: int);
> B = FOREACH A {
>     days_str = (chararray)
>         (m == 1 ? 31: 
>         (m == 2 ? 28: 
>         (m == 3 ? 31: 
>         (m == 4 ? 30: 
>         (m == 5 ? 31: 
>         (m == 6 ? 30: 
>         (m == 7 ? 31: 
>         (m == 8 ? 31: 
>         (m == 9 ? 30: 
>         (m == 10 ? 31: 
>         (m == 11 ? 30:31)))))))))));
> GENERATE
>    days_str as days_str;
> }   
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message