hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-1106) LocalJobRunner should run with any file-system
Date Fri, 13 May 2011 03:57:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13032815#comment-13032815
] 

Amar Kamat commented on MAPREDUCE-1106:
---------------------------------------

Few comments on the latest patch.
1. In the latest patch, I don't see any changes to LocalJobRunner (there are some changes
w.r.t FileSystem in the previous patch).
2. Existing testcases (like testEmptyMaps(), testInvalidMultiMapParallelism(), testMultiMaps()
and testGcCounter()) can be modified to accept a configuration object and 2 new testcases
 can be added (say testLocalJobRunnerWithLocalFS() and testLocalJobRunnerWithHDFS()). This
will keep all the LocalJobRunner related testcases in one place and the diffs to the minimum.

3. Use of spaces instead of tabs. See http://wiki.apache.org/hadoop/HowToContribute (Making
changes section) for more details.



> LocalJobRunner should run with any file-system
> ----------------------------------------------
>
>                 Key: MAPREDUCE-1106
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1106
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>    Affects Versions: 0.21.0
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Rohan A Mehta
>              Labels: newbie
>         Attachments: MAPREDUCE-1106.patch, MAPREDUCE-1106.patch
>
>
> LocalJobRunner is hard-coded to run with only the local file-system. This will help users
write map/reduce programs in local mode yet accessing input/schema/data files etc. from any
file system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message