hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6323) Serialization should provide comparators
Date Mon, 07 Dec 2009 23:40:18 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787197#action_12787197
] 

Aaron Kimball commented on HADOOP-6323:
---------------------------------------

Looking at this issue, it seems that the API needs to be extended with the signature mentioned
in the first comment; then the various implementations (there are three listed above) need
to be updated to match it.

WritableSerialization and JavaSerialization look pretty straightforward at first glance, as
their corresponding RawComparator implementations (WritableComparator and JavaSerializationComparator)
already themselves have factories.

AvroSerialization I think is a bit more complicated -- the schema needs to be read in from
the metadata, then a comparator instantiated over this metadata. I'm not as familiar with
the avro classes involved, so I'd need to keep digging to figure out where exactly this all
lies. Doug?

Jacob, I was actually looking at trying to get this working this week myself -- I finally
freed up some room in my schedule and I figured a crash course in Avro was overdue. Let me
know if you feel strongly about tackling it yourself though.

> Serialization should provide comparators
> ----------------------------------------
>
>                 Key: HADOOP-6323
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6323
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io
>            Reporter: Doug Cutting
>
> The Serialization interface should permit one to create raw comparators.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message