Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 68620DC39 for ; Tue, 4 Sep 2012 08:14:04 +0000 (UTC) Received: (qmail 31631 invoked by uid 500); 4 Sep 2012 08:13:59 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 31539 invoked by uid 500); 4 Sep 2012 08:13:59 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 31527 invoked by uid 99); 4 Sep 2012 08:13:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Sep 2012 08:13:59 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ramesh.narasingu@gmail.com designates 209.85.214.176 as permitted sender) Received: from [209.85.214.176] (HELO mail-ob0-f176.google.com) (209.85.214.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Sep 2012 08:13:54 +0000 Received: by obbtb18 with SMTP id tb18so13270935obb.35 for ; Tue, 04 Sep 2012 01:13:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=HnvWAILrEt+Vfb4+X7KxYi9SFh0v8+l3zj0rjmxRxyg=; b=nPL3kPwr1qaEwEVeDU8nuuUWTUMo1OYynGeyN9jllOLc36C8EE096eBwIA24BYWs2N 2HND8hCWIezjbyOoJsF9tJz4Mm3tV28TLDYKjSrWox5KmssU+pGvtTgXOsP7BRmI/dfq M+I/9PwD5hbm/EXbCX9iZefxNB6+I09h/0+4BbhwcolitjvARVww8Irt/ediESfoURc9 0rBagAacyVWblILZ+6/yqTTLHuVS4VUmZ77mcr/0xciKJUk9wuqqz0oAUCS3GY8C2s62 WS4h4Xpr31NH4z07v2CGH7XYFWh9+aIvtd88zZnLFNfaHgdCsFAw7a4EoEUjKDJVOBvs ZMyA== MIME-Version: 1.0 Received: by 10.182.207.71 with SMTP id lu7mr15367168obc.78.1346746413825; Tue, 04 Sep 2012 01:13:33 -0700 (PDT) Received: by 10.182.65.234 with HTTP; Tue, 4 Sep 2012 01:13:33 -0700 (PDT) In-Reply-To: References: Date: Tue, 4 Sep 2012 13:43:33 +0530 Message-ID: Subject: Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined From: Narasingu Ramesh To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=e89a8f503a9299409804c8dbd503 X-Virus-Checked: Checked by ClamAV on apache.org --e89a8f503a9299409804c8dbd503 Content-Type: text/plain; charset=ISO-8859-1 Hi Rekha, What I said means first he has set install java and then pwd(present working directory) for JAVA_HOME directory and then set to classpath for the hadoop installation. Thanks & Regards, Ramesh.Narasingu On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha wrote: > Hi Andy, > > If you are referring to HADOOP_CLASSPATH, that is env variable on your > cluster or effected via config xml.But if you need your own environment > variables for streaming you may use -cmdenv PATH= on your streaming > command.Or if you have specific jars for the streaming process -libjars > on command works. > > Thanks > Rekha > > From: Andy Xue > Reply-To: > Date: Tue, 4 Sep 2012 17:41:39 +1000 > To: > Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined > > Hi: > > I wish to use Hadoop streaming to run a program which requires specific > PATH and CLASSPATH variables. I have set these two variables in both > "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves). > However, when I run the hadoop streaming job, the program generates error > messages saying that these environment variables are not correctly set. > > Does it mean that I did not set these environment variables in the > correct place? How should I define these environment variables? > I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04 > > Thank you for your time and help. Have a great day. > > Andy > --e89a8f503a9299409804c8dbd503 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi Rekha,
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 What I said means first he has = set install java and then pwd(present working directory) for JAVA_HOME dire= ctory and then set to classpath for the hadoop installation.
Thanks &= ; Regards,
Ramesh.Narasingu

On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha= <Rekha_Joshi@intuit.com> wrote:
Hi Andy,

If you are referring to HADOOP_CLASSPATH, that is env variable on your cluste= r or effected via config xml.But if you need your own environment variables for streaming you may=A0= use=A0-cmdenv PATH= =3D on your streaming command.Or if you have specific jars for the s= treaming process=A0-libjars <application.jar> on command works.

Thanks
Rekha

From: Andy Xue <andyxueyuan@gmail.com> Reply-To: <user@hadoop.apache.org>
Date: Tue, 4 Sep 2012 17:41:39 +100= 0
To: <user@hadoop.apache.org>
Subject: Hadoop Streaming: Does not= recognise PATH and CLASSPATH defined

Hi:

I wish to use Hadoop streaming to run a program which requires specifi= c PATH and CLASSPATH variables. I have set these two variables in both &quo= t;/etc/profile" and "~/.bashrc" on all slaves (and restarted= these slaves). However, when I run the hadoop streaming job, the program generates error messages saying that these environment va= riables are not correctly set.

Does it mean that I did not set these environment variables in the cor= rect place? How should I define these environment variables?
I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04

Thank you for your time and help. Have a great day.

Andy

--e89a8f503a9299409804c8dbd503--