Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: 
 <CALWHDewzphtMz4NJCDm_rYaMZG6s46ARBRJ63B8cpatvRqbgBA@mail.gmail.com>
References: 
 <CALWHDewzphtMz4NJCDm_rYaMZG6s46ARBRJ63B8cpatvRqbgBA@mail.gmail.com>
From: =?UTF-8?Q?Jos=C3=A9_Luis_Larroque?= <larroquester@gmail.com>
Date: Sat, 6 Feb 2016 22:01:35 -0300
Message-ID: 
 <CALWHDezgJEfSyfx=Dothzu=WgTFCtWnc_DcOqCc1KKzjM4uSPQ@mail.gmail.com>
Subject: Re: Redefine yarn.application.classpath value
To: "common-user@hadoop.apache.org" <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=001a11c15d2c60248e052b23a1fd

--001a11c15d2c60248e052b23a1fd
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

In SO someone recommend me this:

"check the place where you are setting $HADOOP_CONF_DIR, you might be
setting that multiple places.. The $HADOOP_CONF_DIR is added by the
bin/hadoop script to the front of the path. "

i'm setting it on hadoop-env.sh:
 export HADOOP_CONF_DIR=3D${HADOOP_CONF_DIR:-"/usr/local/hadoop/etc/hadoop"=
}

But it isn't working, the classpath remains the same. I tried removing it,
but was the same anyway.

Please!!! any help would be greatly appreciated.

Bye!
Jose

2016-01-30 13:42 GMT-03:00 Jos=C3=A9 Luis Larroque <larroquester@gmail.com>=
:

> Hi guys!
>
> i have a Ubuntu 14.04 LTS, with a hadoop 2.4.0 single node cluster. When =
i
> execute yarn classpath on console, gives me this:
>
> /usr/local/hadoop/etc/hadoop:/usr/local/hadoop/etc/hadoop:/usr/local/hado=
op/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop=
/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoo=
p/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/=
hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/l=
ocal/hadoop/share/hadoop/mapreduce/lib/*:/usr/local/hadoop/share/hadoop/map=
reduce/*:/usr/local/hadoop/contrib/capacity-scheduler/*.jar:/usr/local/hado=
op/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*
>
> As you can see, the first value is repeated three times. I looked for a
> way to redefine or reset this. The only way, as far as i know, it's
> redefining a property in yarn-site.xml, like this:
>
>  <property>
>     <description>Classpath for typical applications.</description>
>      <name>yarn.application.classpath</name>
>         <value>
>         $HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/share/hadoop/common/*, $HAD=
OOP_COMMON_HOME/share/hadoop/common/lib/*, $HADO$
>      </value>
>   </property>
>
> But yarn.application.classpath remains the same, without changes, even if
> i stop every process of hadoop and start them all again. What other optio=
n
> do i have? i'm doing something wrong here?
>

--001a11c15d2c60248e052b23a1fd
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div>In SO someone recommend me this:<br><br>&quot;<s=
pan class=3D"">check the place where you are setting <code>$HADOOP_CONF_DIR=
</code>, you might be setting that multiple places.. </span><span class=3D"=
">The $HADOOP_CONF_DIR is added by the bin/hadoop script to the front of th=
e path.</span>
                    &quot;<br><br>
                   =20
               =20
           =20
       =20
       =20
           =20
                <span class=3D"">i&#39;m setting it on <code>hadoop-env.sh<=
/code>:<br>=C2=A0<code>export HADOOP_CONF_DIR=3D${HADOOP_CONF_DIR:-&quot;/u=
sr/local/hadoop/etc/hadoop&quot;}</code></span>
<br><br></div>But it isn&#39;t working, the classpath remains the same. I t=
ried removing it, but was the same anyway.<br></div><div><br>Please!!! any =
help would be greatly appreciated.<br><br>Bye!<br></div><div>Jose</div></di=
v><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">2016-01-30 13:4=
2 GMT-03:00 Jos=C3=A9 Luis Larroque <span dir=3D"ltr">&lt;<a href=3D"mailto=
:larroquester@gmail.com" target=3D"_blank">larroquester@gmail.com</a>&gt;</=
span>:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;bord=
er-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div>Hi guys!<br>=
</div><div><br>i have a Ubuntu 14.04 LTS, with a hadoop 2.4.0 single node c=
luster. When i execute <code>yarn classpath</code> on console, gives me thi=
s:

<pre><code>/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/etc/hadoop:/usr/l=
ocal/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/loc=
al/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/hdfs:/usr/lo=
cal/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/u=
sr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/yarn=
/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*:/usr/local/hadoop/share/h=
adoop/mapreduce/*:/usr/local/hadoop/contrib/capacity-scheduler/*.jar:/usr/l=
ocal/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*
</code></pre>

<p>As you can see, the first value is repeated three times. I looked for
 a way to redefine or reset this. The only way, as far as i know, it&#39;s=
=20
redefining a property in <code>yarn-site.xml</code>, like this:</p>

<pre><code> &lt;property&gt;
    &lt;description&gt;Classpath for typical applications.&lt;/description&=
gt;
     &lt;name&gt;yarn.application.classpath&lt;/name&gt;
        &lt;value&gt;
        $HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/share/hadoop/common/*, $HADOO=
P_COMMON_HOME/share/hadoop/common/lib/*, $HADO$
     &lt;/value&gt;
  &lt;/property&gt;
</code></pre>

<p>But <code>yarn.application.classpath</code> remains the same, without
 changes, even if i stop every process of hadoop and start them all=20
again. What other option do i have? i&#39;m doing something wrong here?</p>=
</div></div>
</blockquote></div><br></div>

--001a11c15d2c60248e052b23a1fd--