hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andy Xue <andyxuey...@gmail.com>
Subject Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Date Tue, 04 Sep 2012 08:30:34 GMT
Hi :

Thank you, Narasingu and Rekha for your help.
So there are no way for hadoop streaming to read an environment variable
from the OS? Guess that I'll have to use the "-cmdenv" command to specify
the PATH and CLASSPATH variables.

Again, appreciate your help.

Andy


On 4 September 2012 18:13, Narasingu Ramesh <ramesh.narasingu@gmail.com>wrote:

> Hi Rekha,
>            What I said means first he has set install java and then
> pwd(present working directory) for JAVA_HOME directory and then set to
> classpath for the hadoop installation.
> Thanks & Regards,
> Ramesh.Narasingu
>
>
> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Rekha_Joshi@intuit.com>wrote:
>
>>  Hi Andy,
>>
>>  If you are referring to HADOOP_CLASSPATH, that is env variable on your
>> cluster or effected via config xml.But if you need your own environment
>> variables for streaming you may use -cmdenv PATH= on your streaming
>> command.Or if you have specific jars for the streaming process -libjars
>> <application.jar> on command works.
>>
>>  Thanks
>>  Rekha
>>
>>   From: Andy Xue <andyxueyuan@gmail.com>
>> Reply-To: <user@hadoop.apache.org>
>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>> To: <user@hadoop.apache.org>
>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>
>>  Hi:
>>
>>  I wish to use Hadoop streaming to run a program which requires specific
>> PATH and CLASSPATH variables. I have set these two variables in both
>> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
>> However, when I run the hadoop streaming job, the program generates error
>> messages saying that these environment variables are not correctly set.
>>
>>  Does it mean that I did not set these environment variables in the
>> correct place? How should I define these environment variables?
>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>
>>  Thank you for your time and help. Have a great day.
>>
>>  Andy
>>
>
>

Mime
View raw message