hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Justin Patterson (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-6129) MapFile doesn't work with serializables other than Writables
Date Tue, 07 Jul 2009 20:10:14 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Justin Patterson updated HADOOP-6129:

    Status: Patch Available  (was: Open)

Here's the patch that I used to get this working in my own app.

It basically uses the SerializationFactory for key/value serialization.  The key comparator
is either specified by the Writer creator or, for legacy reasons, is created through WritableComparator.get().

The MapFileOutputFormat creates the key comparator using job.getMapOutputKeyComparator().

> MapFile doesn't work with serializables other than Writables
> ------------------------------------------------------------
>                 Key: HADOOP-6129
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6129
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io, mapred
>    Affects Versions: 0.20.0
>            Reporter: Justin Patterson
>         Attachments: HADOOP-6129.patch
> Since 0.18 (I think), SequenceFiles have supported serializing arbitrary objects through
the serialization framework.  MapFiles still don't.  They require WritableComparable keys
and Writable values.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message