hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-850) Dump produce wrong result while "store into" is ok
Date Tue, 16 Jun 2009 20:55:07 GMT

     [ https://issues.apache.org/jira/browse/PIG-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Dai updated PIG-850:
---------------------------

    Attachment: PIG-850.patch

When we add extra limit map-reduce operator (see [PIG-364|http://issues.apache.org/jira/browse/PIG-364]),
we should mark the output file in the original map-reduce as temporary; Otherwise, dump will
pick the wrong output file.

> Dump produce wrong result while "store into" is ok
> --------------------------------------------------
>
>                 Key: PIG-850
>                 URL: https://issues.apache.org/jira/browse/PIG-850
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.2.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.3.0
>
>         Attachments: PIG-850.patch
>
>
> The following script will wrongly produce 20 output, however, if we change dump to "store
into", the result is correct. Not sure if the problem is only for limited sort case.
> A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> B = order A by gpa parallel 2;
> C = limit B 10;
> dump C;

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message