hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shrijeet Paliwal <shrij...@rocketfuel.com>
Subject Re: Accessing files from distributed cache
Date Tue, 19 Oct 2010 20:15:42 GMT
Rakesh,
The API: DistributedCache.getLocalCacheFiles(conf) , returns a list of
files added to dist cache.
More on this topic,

Courtesy : Alexander Behm
http://www.ics.uci.edu/~abehm/hadoop.html#howto_distributed_cache

-Shrijeet
On Tue, Oct 19, 2010 at 1:09 PM, rakesh kothari
<rkothari_iit@hotmail.com> wrote:
>
> I am using Hadoop 0.20.1.
>
> -Rakesh
> ________________________________
> From: rkothari_iit@hotmail.com
> To: mapreduce-user@hadoop.apache.org
> Subject: Accessing files from distributed cache
> Date: Tue, 19 Oct 2010 13:03:04 -0700
>
> Hi,
>
> What's the way to access files copied to distributed cache from the map tasks ?
>
> e.g.
>
> if I run my M/R job as $hadoop jar my.jar -files hdfs://path/to/my/file.txt, How can
I access file.txt in my Map(or reduce) task ?
>
>
> Thanks,
> -Rakesh

Mime
View raw message