pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2231) Limit produce wrong number of records after foreach flatten
Date Tue, 23 Aug 2011 17:08:30 GMT

    [ https://issues.apache.org/jira/browse/PIG-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089586#comment-13089586
] 

jiraposter@reviews.apache.org commented on PIG-2231:
----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1627/
-----------------------------------------------------------

Review request for pig and Thejas Nair.


Summary
-------

See PIG-2231


This addresses bug PIG-2231.
    https://issues.apache.org/jira/browse/PIG-2231


Diffs
-----

  trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java 1160494

  trunk/test/org/apache/pig/test/TestEvalPipeline2.java 1160494 

Diff: https://reviews.apache.org/r/1627/diff


Testing
-------

test-patch:
     [exec] +1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec] 
     [exec]     +1 release audit.  The applied patch does not increase the total number of
release audit warnings.

Unit test:
    all pass


Thanks,

Daniel



> Limit produce wrong number of records after foreach flatten
> -----------------------------------------------------------
>
>                 Key: PIG-2231
>                 URL: https://issues.apache.org/jira/browse/PIG-2231
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.1, 0.9.0, 0.10
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.9.1, 0.10
>
>         Attachments: PIG-2231-1.patch
>
>
> From user mailing list: http://mail-archives.apache.org/mod_mbox/pig-user/201108.mbox/%3CCAPad=8E032ksPjy2bOynQezo1x+=0jXBh4t+MstS7G_fvj_EhQ@mail.gmail.com%3E,
Sungho reported the following script produce wrong result as expected:
> data = LOAD '1.txt' AS (k, v);
> grouped = GROUP data BY k;
> selected = LIMIT grouped 2;
> flattened = FOREACH selected GENERATE FLATTEN (data);
> dump flattened;
> 1.txt:
> 1       A
> 1       B
> 2       C
> 3       D
> 3       E
> 3       F
> Expected result:
> (1, A)
> (1, B)
> (2, C)
> We get:
> (1, A)
> (1, B)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message