Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2112A6A2B for ; Fri, 10 Jun 2011 00:36:01 +0000 (UTC) Received: (qmail 99827 invoked by uid 500); 10 Jun 2011 00:36:00 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 99663 invoked by uid 500); 10 Jun 2011 00:36:00 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 99651 invoked by uid 99); 10 Jun 2011 00:36:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jun 2011 00:36:00 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of mapred.learn@gmail.com designates 209.85.212.178 as permitted sender) Received: from [209.85.212.178] (HELO mail-px0-f178.google.com) (209.85.212.178) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jun 2011 00:35:54 +0000 Received: by pxj1 with SMTP id 1so1465840pxj.37 for ; Thu, 09 Jun 2011 17:35:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:date:message-id:subject:from:to :content-type; bh=mfhi4SKpFZqHqi8S/RJ306pZm0IGGHjeYUIc08el+TA=; b=h26EP1+sdFqjcVcKPhXpQoqkW3RQGKU97/tcEFZfSfNoVVFOuQeqklm/6NT4TSm+GT HbeQu5J5cevsDvd6+GUU0mwERgnJzcJHMwpMvdsXfZkfrzWkZE7PoCXCDJpKuEgU77Ai bajx+OhozAqy4kwwW/ytTrjiwsaeIX/qaSe5E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=VdsCXmRNMIZ8RiovS1+Zd7nQ9GrKanPGYXpagcJqX84QQ9/uD8V9XG9C9ZhDiw2JWS J0gMpt1dy+5Ko9bv5Hv/OTYoguxmBMgerPDBvqaZT1w7sC7zyIpuXNTaTdViUvY2g6T0 TiLMY5qbPU5+y1wfzGDYPd6DG6+QNsSl7IdxA= MIME-Version: 1.0 Received: by 10.142.241.3 with SMTP id o3mr231774wfh.344.1307666133500; Thu, 09 Jun 2011 17:35:33 -0700 (PDT) Received: by 10.142.84.4 with HTTP; Thu, 9 Jun 2011 17:35:33 -0700 (PDT) Date: Thu, 9 Jun 2011 17:35:33 -0700 Message-ID: Subject: How to send files to task trackers in a map-red job From: Mapred Learn To: mapreduce-user@hadoop.apache.org, cdh-user@cloudera.org Content-Type: multipart/alternative; boundary=000e0cd145705f447b04a550bf96 --000e0cd145705f447b04a550bf96 Content-Type: text/plain; charset=ISO-8859-1 Hi, I have 2 files that I want to send to all tasktrackers during job execution. I try something like: hadoop jar abc.jar

-conf -cacheFile 'hdfs://:port/user/jj/dummy/abc.dat#abc' -cacheFile 'hdfs://:port/user/jj/dummy/abc.txt#abc1' But looks like I don't get second file to the task trackers and all task trackers fail with exception - "file not found: /user/jj/dummy/abc.txt". Could somebody please guide me to the right way how to get files to all the data nodes in a map-red job ? Thanks, JJ --000e0cd145705f447b04a550bf96 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Hi,

I have 2 files that I want to send to all tasktrackers during job exec= ution.

I try something like:

hadoop jar abc.jar <main class> -conf <conf file> -cacheFi= le 'hdfs://<namenode>:port/user/jj/dummy/abc.dat#abc' -cacheF= ile 'hdfs://<namenode>:port/user/jj/dummy/abc.txt#abc1'

=A0

But looks like I don't get second file to the task trackers and al= l task trackers fail with exception - "file not found: /user/jj/dummy/= abc.txt".

=A0

Could somebody please guide me to=A0the right way how to get files to = all the data nodes in a=A0map-red job=A0?

=A0

Thanks,

JJ

--000e0cd145705f447b04a550bf96--