hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-878) reducer NONE does not work with multiple maps
Date Wed, 21 Feb 2007 03:36:05 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arun C Murthy updated HADOOP-878:
---------------------------------

    Attachment: HADOOP-878_20070220_1.patch

PipeMapRed:getSideEffectFileName which would put ':' in the 'fileName' as <fileName:offset:length>
(via FileInput.toString()); this multiple colons cause an URI exception while constructing
the path.

I've fixed that to put '-' instead of ':' and seems to work... I'd appreciate any review/feedback
since I'm not too conversant with streaming...

Mahadev, could you check this patch and let me know if it works? Thanks!

> reducer NONE does not work with multiple maps
> ---------------------------------------------
>
>                 Key: HADOOP-878
>                 URL: https://issues.apache.org/jira/browse/HADOOP-878
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Mahadev konar
>         Assigned To: Mahadev konar
>            Priority: Minor
>         Attachments: HADOOP-878_20070220_1.patch
>
>
> If you execute more than one maps with -reducer None output data seems to get lost. The
number of lines output with identity reducer is greater than the number of lines output using
reducer NONE.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message