Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AA178DB75 for ; Fri, 21 Dec 2012 22:03:12 +0000 (UTC) Received: (qmail 94260 invoked by uid 500); 21 Dec 2012 22:03:12 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 94228 invoked by uid 500); 21 Dec 2012 22:03:12 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 94219 invoked by uid 99); 21 Dec 2012 22:03:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Dec 2012 22:03:12 +0000 Date: Fri, 21 Dec 2012 22:03:12 +0000 (UTC) From: "Jason Lowe (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (MAPREDUCE-4793) Problem with adding resources when using both -files and -file to hadoop streaming MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4793: ---------------------------------- Assignee: Jason Lowe Target Version/s: 2.0.3-alpha, 0.23.6 Status: Patch Available (was: Open) > Problem with adding resources when using both -files and -file to hadoop streaming > ---------------------------------------------------------------------------------- > > Key: MAPREDUCE-4793 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4793 > Project: Hadoop Map/Reduce > Issue Type: Bug > Affects Versions: 0.23.3 > Reporter: Thomas Graves > Assignee: Jason Lowe > Attachments: MAPREDUCE-4793.patch > > > It seems when > both -files and -file are present, it will trigger this IAE, and the error > message is just misleading. > hadoop jar $HADOOP_PREFIX/share/hadoop/tools/lib/hadoop-streaming.jar > -files > hdfs://host:port/user/foo/access.log#test > -input 'input' -output 'output' -mapper "egrep '.*'" -file tmp.file > Below is the error message > 12/11/02 07:37:54 INFO mapreduce.JobSubmitter: Cleaning up the staging area > /user/haiyang/.staging/job_1351804437209_0575 > Exception in thread "main" java.lang.IllegalArgumentException: Resource name > must be relative > at > org.apache.hadoop.mapreduce.v2.util.MRApps.parseDistributedCacheArtifacts(MRApps.java:383) > at > org.apache.hadoop.mapreduce.v2.util.MRApps.setupDistributedCache(MRApps.java:324) > at > org.apache.hadoop.mapred.YARNRunner.createApplicationSubmissionContext(YARNRunner.java:419) > at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:288) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira