hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-344) Ordering on types other than byte array fails.
Date Tue, 29 Jul 2008 00:14:33 GMT

    [ https://issues.apache.org/jira/browse/PIG-344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617625#action_12617625
] 

Alan Gates commented on PIG-344:
--------------------------------

In response to Santhosh's concern about the byte array in getQuantileJob:

getQuantileJob always uses a group all for the rearrange and POSort for sorting the sample
bag.  The POSort seems to be doing the right things regardless of the data type on the project.
 I tested it and it works fine, so I'm not going to mess with it.

> Ordering on types other than byte array fails.
> ----------------------------------------------
>
>                 Key: PIG-344
>                 URL: https://issues.apache.org/jira/browse/PIG-344
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Critical
>             Fix For: types_branch
>
>         Attachments: sortkey.patch
>
>
> {code}
> A = load '/Users/gates/test/data/studenttab10' as (name: chararray, age: long, gpa: float);
> B = order A by gpa;
> dump B;
> {code}
> java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.BytesWritable,
recieved org.apache.hadoop.io.FloatWritable
>         at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:419)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.collect(PigMapReduce.java:79)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:119)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.map(PigMapReduce.java:71)
>         at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:157)
> If the gpa type is not declared, then the sort passes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message