hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-680) Reuse of Writable objects is improperly handled by MRUnit
Date Fri, 10 Jul 2009 00:10:14 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12729465#action_12729465

Aaron Kimball commented on MAPREDUCE-680:

The contrib failures are in streaming, not MRUnit.

> Reuse of Writable objects is improperly handled by MRUnit
> ---------------------------------------------------------
>                 Key: MAPREDUCE-680
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-680
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-680.patch
> As written, MRUnit's MockOutputCollector simply stores references to the objects passed
in to its collect() method. Thus if the same Text (or other Writable) object is reused as
an output containiner multiple times with different values, these separate values will not
all be collected. MockOutputCollector needs to properly use io.serializations to deep copy
the objects sent in.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message