hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-878) reducer NONE does not work with multiple maps
Date Wed, 21 Feb 2007 03:36:05 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Arun C Murthy updated HADOOP-878:

    Attachment: HADOOP-878_20070220_1.patch

PipeMapRed:getSideEffectFileName which would put ':' in the 'fileName' as <fileName:offset:length>
(via FileInput.toString()); this multiple colons cause an URI exception while constructing
the path.

I've fixed that to put '-' instead of ':' and seems to work... I'd appreciate any review/feedback
since I'm not too conversant with streaming...

Mahadev, could you check this patch and let me know if it works? Thanks!

> reducer NONE does not work with multiple maps
> ---------------------------------------------
>                 Key: HADOOP-878
>                 URL: https://issues.apache.org/jira/browse/HADOOP-878
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Mahadev konar
>         Assigned To: Mahadev konar
>            Priority: Minor
>         Attachments: HADOOP-878_20070220_1.patch
> If you execute more than one maps with -reducer None output data seems to get lost. The
number of lines output with identity reducer is greater than the number of lines output using
reducer NONE.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message