hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4773) MultipleOutput with different output path for each
Date Tue, 06 Nov 2012 11:34:15 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491397#comment-13491397
] 

Harsh J commented on MAPREDUCE-4773:
------------------------------------

The specific method: http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.html#write(KEYOUT,%20VALUEOUT,%20java.lang.String)
in new API MO, allows you to specify calls such as {{mo.write(keyObj, valObj, "dynamic/custom/subdir/path/string");}}.
This ends up writing in job output dir subdirectory {{dynamic/custom/subdir}} with partitioned
files prefixed with {{string-}}.
                
> MultipleOutput with different output path for each 
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-4773
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4773
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Rohit Dandona
>
> Is it possible to have multiple outputs in a map reduce code where each output is directed
to a different path ?
> e.g. 
> FileOutputFormat.setOutputPath(job, new Path(outputPath));
> MultipleOutputs.addNamedOutput(job, "Output 1", TextOutputFormat.class, Text.class, Text.class);
> MultipleOutputs.addNamedOutput(job, "Output 2", TextOutputFormat.class, Text.class, Text.class);
> Can "Output 1" & "Output 2" be alloted seperate paths ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message