hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sameer Paranjpye (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-525) Need raw comparators for hadoop record types
Date Tue, 12 Sep 2006 22:49:22 GMT
Need raw comparators for hadoop record types

                 Key: HADOOP-525
                 URL: http://issues.apache.org/jira/browse/HADOOP-525
             Project: Hadoop
          Issue Type: Improvement
          Components: record
    Affects Versions: 0.6.0
            Reporter: Sameer Paranjpye
         Assigned To: Milind Bhandarkar
            Priority: Minor
             Fix For: 0.7.0

Raw comparators are not generated for types that are generated with the Hadoop record framework.
This could have a substantial performance impact when using hadoop record generated types
in Map/Reduce. The record i/o framework should auto-generate raw comparators for types.

Comparison for hadoop record i/o types is defined to be member wise comparison of objects.
A possible implementation could only deserialize one member from each object at a time, compare
them and either return or move on to the next member if the values are equal.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message