hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Santhosh Srinivasan (JIRA)" <j...@apache.org>
Subject [jira] Issue Comment Edited: (PIG-344) Ordering on types other than byte array fails.
Date Mon, 28 Jul 2008 20:47:31 GMT

    [ https://issues.apache.org/jira/browse/PIG-344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617539#action_12617539
] 

sms edited comment on PIG-344 at 7/28/08 1:45 PM:
------------------------------------------------------------------

The getSortJob looks good. The getQuantileJob has similar code where the result type of the
project operator is set to DataType.BYTEARRAY instead of the type of the projection operator.
Maybe this code has to change to reflect the logic in the getSortJob method.

      was (Author: sms):
    +1
  
> Ordering on types other than byte array fails.
> ----------------------------------------------
>
>                 Key: PIG-344
>                 URL: https://issues.apache.org/jira/browse/PIG-344
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>            Priority: Critical
>             Fix For: types_branch
>
>         Attachments: sortkey.patch
>
>
> {code}
> A = load '/Users/gates/test/data/studenttab10' as (name: chararray, age: long, gpa: float);
> B = order A by gpa;
> dump B;
> {code}
> java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.BytesWritable,
recieved org.apache.hadoop.io.FloatWritable
>         at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:419)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.collect(PigMapReduce.java:79)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:119)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.map(PigMapReduce.java:71)
>         at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:157)
> If the gpa type is not declared, then the sort passes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message