hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1195) POSort should take care of sort order
Date Tue, 19 Jan 2010 19:00:54 GMT

     [ https://issues.apache.org/jira/browse/PIG-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Dai updated PIG-1195:
----------------------------

    Description: 
POSort always use ascending order. We shall obey the sort order as specified in the script.

For example, the following script does not do the right thing if we turn off secondary sort
(which means, we will rely on POSort to sort):
{code}
A = load 'input' as (a0:int);
B = group A ALL;
C = foreach B {
    D = order A by a0 desc;
    generate D;
};
dump C;
{code}

If we run it using the command line "java -Xmx512m -Dpig.exec.nosecondarykey=true -jar pig.jar
1.pig".

The sort order for D is ascending.

  was:
InternalSortedBag always use ascending order. We shall obey the sort order as specified in
the script.

For example, the following script does not do the right thing if we turn off secondary sort
(which means, we will rely on InternalSortedBag to sort):
{code}
A = load 'input' as (a0:int);
B = group A ALL;
C = foreach B {
    D = order A by a0 desc;
    generate D;
};
dump C;
{code}

If we run it using the command line "java -Xmx512m -Dpig.exec.nosecondarykey=true -jar pig.jar
1.pig".

The sort order for D is ascending.

        Summary: POSort should take care of sort order  (was: InternalSortedBag should take
care of sort order)

> POSort should take care of sort order
> -------------------------------------
>
>                 Key: PIG-1195
>                 URL: https://issues.apache.org/jira/browse/PIG-1195
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.6.0
>            Reporter: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1195-1.patch, PIG-1195-2.patch
>
>
> POSort always use ascending order. We shall obey the sort order as specified in the script.
> For example, the following script does not do the right thing if we turn off secondary
sort (which means, we will rely on POSort to sort):
> {code}
> A = load 'input' as (a0:int);
> B = group A ALL;
> C = foreach B {
>     D = order A by a0 desc;
>     generate D;
> };
> dump C;
> {code}
> If we run it using the command line "java -Xmx512m -Dpig.exec.nosecondarykey=true -jar
pig.jar 1.pig".
> The sort order for D is ascending.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message