avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julien Muller (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-944) Java: reduce-side combine uses wrong serializer
Date Sat, 29 Oct 2011 18:35:32 GMT

    [ https://issues.apache.org/jira/browse/AVRO-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139392#comment-13139392
] 

Julien Muller commented on AVRO-944:
------------------------------------

I have jobs that presented the same symptoms when having a combiner. 
We ran some testing on our jobs with this patch on 1.5.1 and the result is successful. 
This is good news that this patch will be included in the RC, since using the combiner divided
the job execution time by 30!
                
> Java: reduce-side combine uses wrong serializer
> -----------------------------------------------
>
>                 Key: AVRO-944
>                 URL: https://issues.apache.org/jira/browse/AVRO-944
>             Project: Avro
>          Issue Type: Bug
>          Components: java
>    Affects Versions: 1.6.0
>            Reporter: Doug Cutting
>            Assignee: Doug Cutting
>             Fix For: 1.6.0
>
>         Attachments: AVRO-944.patch
>
>
> When a reduce-side combine is run, Avro's mapreduce API incorrectly uses the final output
serializer rather than the map-output serializer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message