hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From José Luis Larroque <larroques...@gmail.com>
Subject Re: Redefine yarn.application.classpath value
Date Sun, 07 Feb 2016 01:01:35 GMT
In SO someone recommend me this:

"check the place where you are setting $HADOOP_CONF_DIR, you might be
setting that multiple places.. The $HADOOP_CONF_DIR is added by the
bin/hadoop script to the front of the path. "

i'm setting it on hadoop-env.sh:
 export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/usr/local/hadoop/etc/hadoop"}

But it isn't working, the classpath remains the same. I tried removing it,
but was the same anyway.

Please!!! any help would be greatly appreciated.


2016-01-30 13:42 GMT-03:00 José Luis Larroque <larroquester@gmail.com>:

> Hi guys!
> i have a Ubuntu 14.04 LTS, with a hadoop 2.4.0 single node cluster. When i
> execute yarn classpath on console, gives me this:
> /usr/local/hadoop/etc/hadoop:/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/contrib/capacity-scheduler/*.jar:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*
> As you can see, the first value is repeated three times. I looked for a
> way to redefine or reset this. The only way, as far as i know, it's
> redefining a property in yarn-site.xml, like this:
>  <property>
>     <description>Classpath for typical applications.</description>
>      <name>yarn.application.classpath</name>
>         <value>
>         $HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/share/hadoop/common/*, $HADOOP_COMMON_HOME/share/hadoop/common/lib/*,
>      </value>
>   </property>
> But yarn.application.classpath remains the same, without changes, even if
> i stop every process of hadoop and start them all again. What other option
> do i have? i'm doing something wrong here?

View raw message