Return-Path: Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: (qmail 35176 invoked from network); 1 Jun 2010 07:43:00 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 1 Jun 2010 07:43:00 -0000 Received: (qmail 44797 invoked by uid 500); 1 Jun 2010 07:43:00 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 44705 invoked by uid 500); 1 Jun 2010 07:43:00 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 44696 invoked by uid 99); 1 Jun 2010 07:42:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Jun 2010 07:42:59 +0000 X-ASF-Spam-Status: No, hits=-1484.3 required=10.0 tests=ALL_TRUSTED,AWL X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Jun 2010 07:42:59 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o517gciZ015321 for ; Tue, 1 Jun 2010 07:42:39 GMT Message-ID: <18748987.99651275378158930.JavaMail.jira@thor> Date: Tue, 1 Jun 2010 03:42:38 -0400 (EDT) From: "Amareshwari Sriramadasu (JIRA)" To: mapreduce-issues@hadoop.apache.org Subject: [jira] Updated: (MAPREDUCE-572) If #link is missing from uri format of -cacheArchive then streaming does not throw error. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-572: ---------------------------------------------- Attachment: patch-572-2.txt Patch replaces ArrayList with HashSet and does a contains check before adding to the Set. > If #link is missing from uri format of -cacheArchive then streaming does not throw error. > ----------------------------------------------------------------------------------------- > > Key: MAPREDUCE-572 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-572 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/streaming > Reporter: Karam Singh > Assignee: Amareshwari Sriramadasu > Priority: Minor > Fix For: 0.22.0 > > Attachments: patch-572-1.txt, patch-572-2.txt, patch-572.txt > > > Ran hadoop streaming command as -: > bin/hadoop jar contrib/streaming/hadoop-*-streaming.jar -input in -output out -mapper "xargs cat" -reducer "bin/cat" -cahceArchive hdfs://h:p/pathofJarFile > Streaming submits job to jobtracker and map fails. > For similar with -cacheFile -: > bin/hadoop jar contrib/streaming/hadoop-*-streaming.jar -input in -output out -mapper "xargs cat" -reducer "bin/cat" -cahceFile hdfs://h:p/pathofFile > followinng error is repoerted back -: > [ > You need to specify the uris as hdfs://host:port/#linkname,Please specify a different link name for all of your caching URIs > ] > Streaming should check about present #link after uri of cacheArchive and should throw proper error . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.