hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Philip Zeyliger (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-476) extend DistributedCache to work locally (LocalJobRunner)
Date Thu, 09 Jul 2009 18:16:14 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Philip Zeyliger updated MAPREDUCE-476:
--------------------------------------

    Attachment: MAPREDUCE-476-v2.patch

In light of MAPREDUCE-711, I generated a new patch.  I applied MAPREDUCE-711-20090709-mapreduce.1.txt
first, so this shouldn't be submitted to Hudson until after that gets checked in.  I generated
the patch by applying

bq. cat HADOOP-2914-v3.patch | sed -e 's%src/core/%src/java/%g' | sed -e 's%src/mapred/%src/java/%g'
| sed -e 's%src/test/core%src/test/mapred%g' | patch -p0

I had to clean up DistributedCache.java a tiny bit (there were 2 rejects) because some Javadoc
links were removed in the project move; I've reinstated them.  (I think they were removed
because they pointed to MR from Common, but that's no longer an issue with MAPREDUCE-711.)


> extend DistributedCache to work locally (LocalJobRunner)
> --------------------------------------------------------
>
>                 Key: MAPREDUCE-476
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-476
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: sam rash
>            Assignee: Philip Zeyliger
>            Priority: Minor
>         Attachments: HADOOP-2914-v1-full.patch, HADOOP-2914-v1-since-4041.patch, HADOOP-2914-v2.patch,
HADOOP-2914-v3.patch, MAPREDUCE-476-v2.patch, MAPREDUCE-476.patch
>
>
> The DistributedCache does not work locally when using the outlined recipe at http://hadoop.apache.org/core/docs/r0.16.0/api/org/apache/hadoop/filecache/DistributedCache.html

> Ideally, LocalJobRunner would take care of populating the JobConf and copying remote
files to the local file sytem (http, assume hdfs = default fs = local fs when doing local
development.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message