Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 38339 invoked from network); 18 Jul 2007 15:37:50 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 18 Jul 2007 15:37:50 -0000 Received: (qmail 93472 invoked by uid 500); 18 Jul 2007 15:37:28 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 93386 invoked by uid 500); 18 Jul 2007 15:37:28 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 93342 invoked by uid 99); 18 Jul 2007 15:37:28 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Jul 2007 08:37:28 -0700 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Jul 2007 08:37:25 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id B4F4B7141ED for ; Wed, 18 Jul 2007 08:37:04 -0700 (PDT) Message-ID: <30590177.1184773024738.JavaMail.jira@brutus> Date: Wed, 18 Jul 2007 08:37:04 -0700 (PDT) From: "Runping Qi (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Commented: (HADOOP-1622) Hadoop should provide a way to allow the user to specify jar file(s) the user job depends on In-Reply-To: <17905327.1184698384749.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12513617 ] Runping Qi commented on HADOOP-1622: ------------------------------------ If the user's jar does not have the main function (when the user uses Aggregate, Streaming, DataJoin, etc.), his/her jar file(s) will not be picked up. Plus, in many cases, the user's job may also depend on some third party jars. It is much more convenient for the user to just list the jars at job submission time than to jar them together . > Hadoop should provide a way to allow the user to specify jar file(s) the user job depends on > -------------------------------------------------------------------------------------------- > > Key: HADOOP-1622 > URL: https://issues.apache.org/jira/browse/HADOOP-1622 > Project: Hadoop > Issue Type: Improvement > Reporter: Runping Qi > > More likely than not, a user's job may depend on multiple jars. > Right now, when submitting a job through bin/hadoop, there is no way for the user to specify that. > A walk around for that is to re-package all the dependent jars into a new jar or put the dependent jar files in the lib dir of the new jar. > This walk around causes unnecessary inconvenience to the user. Furthermore, if the user does not own the main function > (like the case when the user uses Aggregate, or datajoin, streaming), the user has to re-package those system jar files too. > It is much desired that hadoop provides a clean and simple way for the user to specify a list of dependent jar files at the time > of job submission. Someting like: > bin/hadoop .... --depending_jars j1.jar:j2.jar -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.