hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1320) Rewrite 'random-writer' to use '-reducer NONE'
Date Mon, 11 Jun 2007 14:59:26 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12503427

Arun C Murthy commented on HADOOP-1320:

I realise, rather belatedly, that changing the filename of the output of {{MapTask.DirectMapOutputCollector}}
to make it compatible with that of {{ReduceTask}} results in changes to output of streaming's
*-reducer NONE* too (e.g. I had to fix {{org.apache.hadoop.streaming.TestStreamReduceNone}})
- is this a big concern for streaming users? Runping? Arkday?

> Rewrite 'random-writer' to use '-reducer NONE'
> ----------------------------------------------
>                 Key: HADOOP-1320
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1320
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: examples
>    Affects Versions: 0.12.3
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>            Priority: Minor
>             Fix For: 0.14.0
>         Attachments: HADOOP-1320_1_20070611.patch, HADOOP-1320_2_20070611.patch
> Post HADOOP-1216 the 'random-writer' is archaic in the sense that it uses custom code
to write data to dfs, this is now supported by the framework and doesn't make sense to reinvent
the wheel here.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message