hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J Chouraria (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-2225) MultipleOutputs should not require the use of 'Writable'
Date Thu, 06 Jan 2011 04:01:47 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Harsh J Chouraria updated MAPREDUCE-2225:

      Environment: Linux
    Fix Version/s:     (was: 0.23.0)

Perhaps this could go in 0.22 itself, if improvements are still accepted?

> MultipleOutputs should not require the use of 'Writable'
> --------------------------------------------------------
>                 Key: MAPREDUCE-2225
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2225
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: job submission
>    Affects Versions: 0.20.1
>         Environment: Linux
>            Reporter: Harsh J Chouraria
>            Assignee: Harsh J Chouraria
>             Fix For: 0.22.0
>         Attachments: multipleoutputs.nowritables.r1.diff, multipleoutputs.nowritables.r2.diff
>   Original Estimate: 0.02h
>  Remaining Estimate: 0.02h
> MultipleOutputs right now requires for Key/Value classes to utilize the Writable and
WritableComparable interfaces, and fails if the associated key/value classes aren't doing
> With support for alternates like Avro serialization, using Writables isn't necessary
and thus the MO class must not strictly check for them.
> And since comparators may be given separately, key class doesn't need to be checked for
implementing a comparable (although it is good design if the key class does implement Comparable
at least).
> Am not sure if this brings about an incompatible change (does Java have BIC? No idea).

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message