Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of mapred.learn@gmail.com
 designates 74.125.83.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=references:in-reply-to:mime-version:content-transfer-encoding
         :content-type:message-id:cc:x-mailer:from:subject:date:to;
        b=iJH8M4wUYAftEcsTzuyTkcp36nwoAmKbjBXIY1K+yxsMK/oTWbknGzCqTiu4wuisfu
         29UIBK/R/KGX/h8E4fXoaqC5pPbCb7R2sK7mVB8WN9yn5EOZ9yMc5fnoIta8rb4Pwe4Y
         H/ahOFcMqSUfZ435z+jRNzi82JTo0aimor+CY=
References: <BANLkTi=UoRJyWzUn+k27mRk=YF0hUR3HRA@mail.gmail.com>
In-Reply-To: <BANLkTi=UoRJyWzUn+k27mRk=YF0hUR3HRA@mail.gmail.com>
Mime-Version: 1.0 (iPhone Mail 8F190)
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii
Message-Id: <761BF0BA-73B8-4E90-B505-D629FCC0F24C@gmail.com>
Cc: "mapreduce-user@hadoop.apache.org" <mapreduce-user@hadoop.apache.org>,
 "cdh-user@cloudera.org" <cdh-user@cloudera.org>
From: Mapred Learn <mapred.learn@gmail.com>
Subject: Re: How to send files to task trackers in a map-red job
Date: Thu, 9 Jun 2011 23:06:43 -0700
To: Mapred Learn <mapred.learn@gmail.com>

Resending, in case anybody has any inputs :::


On Jun 9, 2011, at 5:35 PM, Mapred Learn <mapred.learn@gmail.com> wrote:

> Hi,
> I have 2 files that I want to send to all tasktrackers during job executio=
n.
> I try something like:
> hadoop jar abc.jar <main class> -conf <conf file> -cacheFile 'hdfs://<name=
node>:port/user/jj/dummy/abc.dat#abc' -cacheFile 'hdfs://<namenode>:port/use=
r/jj/dummy/abc.txt#abc1'
> =20
> But looks like I don't get second file to the task trackers and all task t=
rackers fail with exception - "file not found: /user/jj/dummy/abc.txt".
> =20
> Could somebody please guide me to the right way how to get files to all th=
e data nodes in a map-red job ?
> =20
> Thanks,
> JJ