Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CB7FF10F12 for ; Fri, 9 Aug 2013 02:31:38 +0000 (UTC) Received: (qmail 83767 invoked by uid 500); 9 Aug 2013 02:31:33 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 83683 invoked by uid 500); 9 Aug 2013 02:31:32 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 83676 invoked by uid 99); 9 Aug 2013 02:31:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Aug 2013 02:31:32 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.223.169 as permitted sender) Received: from [209.85.223.169] (HELO mail-ie0-f169.google.com) (209.85.223.169) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Aug 2013 02:31:26 +0000 Received: by mail-ie0-f169.google.com with SMTP id qd12so3282611ieb.14 for ; Thu, 08 Aug 2013 19:31:05 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=4vkchLUx7MUh8FXTq4/qW99eyIXzUO86ipMkDrUEU9o=; b=IytME4lFJvdJe4m0o0ER5D7ZC7lfQZjT1hHjOTWZuVviQuF260Ki9JKEsUWQPvXQjN /nVuTFTK/HH/CM5GpfUj6yKLrxa5rrkZsyLz6NJ7K0inszwgkaIcOeksiQccfj7BdFEO uflEPJDFuelKP9QfuCbxUFXd0vkTVL7QnVnzpP1b1ntMkc2qeQupnLvD4bgBOvcsrI6N ru3643gKrYTXBv7u7xeJrSOBIRrJ37hucqRtbCeXWda2+VozG2lLnPDXsoJ1V/lT4Qcu 8XmBoUhl9+VZ0JlHtCfbD8mCR7SnHiuNS36+Fhx3LVZmbBYMD7f1mfySKFFRVfh0Ptnv iF0A== X-Gm-Message-State: ALoCoQkRJtqsr+oxyqsxORPQtjqhHF+6i8OF7UQQ6ewb3NlqAezXjnH6vuXfEhgIE/GHg83ZY/8W X-Received: by 10.43.78.196 with SMTP id zn4mr3546546icb.55.1376015465657; Thu, 08 Aug 2013 19:31:05 -0700 (PDT) MIME-Version: 1.0 Received: by 10.50.95.199 with HTTP; Thu, 8 Aug 2013 19:30:45 -0700 (PDT) In-Reply-To: <520445E0.30609@gmail.com> References: <520445E0.30609@gmail.com> From: Harsh J Date: Fri, 9 Aug 2013 08:00:45 +0530 Message-ID: Subject: Re: alternative to $HADOOP_HOME/lib To: "" Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org John, I assume you do not wish to be using the DistributedCache (or a HDFS location for DistributedCache), which is the most ideal way to ship jars. You can place your jars onto the TT classpaths by placing them at an arbitrary location such as /opt/jars, and editing the TT's hadoop-env.sh to extend HADOOP_CLASSPATH to include this extra location. This would still require administrative configuration edits, and service restarts each time you want to add a new jar or change a jar. With DC, these aren't required. On Fri, Aug 9, 2013 at 6:59 AM, Sanjeev Verma wrote: > On 08/08/2013 09:23 PM, John Hancock wrote: >> >> Where else might one put .jar files that a map/reduce job will need? > > Why do you need an alternative location? Is there a constraint on being able > to place your library jars under $HADOOP_HOME/lib? -- Harsh J