hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-1106) LocalJobRunner should run with any file-system
Date Thu, 12 May 2011 00:28:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13032199#comment-13032199
] 

Todd Lipcon commented on MAPREDUCE-1106:
----------------------------------------

I'm a little confused by this JIRA. It seems that {{LocalJobRunner.fs}} is only used for the
system files and staging area. Even if you're running a job with input or output on HDFS,
these still make sense to keep on the local FS.

So, what is the use case that this JIRA attempts to address?

> LocalJobRunner should run with any file-system
> ----------------------------------------------
>
>                 Key: MAPREDUCE-1106
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1106
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>    Affects Versions: 0.21.0
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Rohan A Mehta
>              Labels: newbie
>         Attachments: MAPREDUCE-1106.patch
>
>
> LocalJobRunner is hard-coded to run with only the local file-system. This will help users
write map/reduce programs in local mode yet accessing input/schema/data files etc. from any
file system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message