hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: Using addCacheArchive
Date Thu, 02 Jul 2009 19:25:09 GMT
This code assumes that the files are in the working directory of the mapper.

You should ask the cache where they are instead nad use the the paths that
it gives you.

See the code on this page:

      http://developer.yahoo.com/hadoop/tutorial/module5.html#auxdata

On Fri, Jun 26, 2009 at 5:55 PM, akhil1988 <akhilanger@gmail.com> wrote:

> FileInputStream fin = new FileInputStream("Config/file1.config");
>
> where,
> Config is a directory which contains many files/directories, one of which
> is
> file1.config
>
> It would be helpful to me if you can tell me what statements to use to
> distribute a directory to the tasktrackers.
> The API doc http://hadoop.apache.org/core/docs/r0.20.0/api/index.html says
> that archives are unzipped on the tasktrackers but I want an example of how
> to use this in case of a dreictory.




-- 
Ted Dunning, CTO
DeepDyve

111 West Evelyn Ave. Ste. 202
Sunnyvale, CA 94086
http://www.deepdyve.com
858-414-0013 (m)
408-773-0220 (fax)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message