hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HADOOP-113) Allow multiple Output Dirs to be specified for a job
Date Thu, 24 May 2007 06:21:16 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Owen O'Malley resolved HADOOP-113.
----------------------------------

    Resolution: Won't Fix
      Assignee:     (was: Owen O'Malley)

The way that Hadoop would deal with this these days is to have a pair of static methods in
the specific OutputFormat that supports multiple directories. So there would be no need to
add them into JobConf.

> Allow multiple Output Dirs to be specified for a job
> ----------------------------------------------------
>
>                 Key: HADOOP-113
>                 URL: https://issues.apache.org/jira/browse/HADOOP-113
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.1.0
>            Reporter: Rod Taylor
>         Attachments: hadoop_multisegment.patch
>
>
> Allow a single job to create multiple outputs. 2 additional simple functions only
> This allows for more complex branching of the process to occur either with multiple steps
of the same type or allow different actions to take place on each output directory depending
on the required actions.
> For my specific use, it allows me to run multiple Generate Outputs instead of a single
Generate Output as submitted in NUTCH-171(http://issues.apache.org/jira/browse/NUTCH-171)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message