Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7DDC6189AA for ; Sun, 6 Mar 2016 19:48:26 +0000 (UTC) Received: (qmail 23051 invoked by uid 500); 6 Mar 2016 19:48:22 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 22915 invoked by uid 500); 6 Mar 2016 19:48:22 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 22904 invoked by uid 99); 6 Mar 2016 19:48:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 06 Mar 2016 19:48:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id ACEB8C17AF for ; Sun, 6 Mar 2016 19:48:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id L-Z_uRC7yo59 for ; Sun, 6 Mar 2016 19:48:20 +0000 (UTC) Received: from mail-ob0-f180.google.com (mail-ob0-f180.google.com [209.85.214.180]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 8FC925F3F2 for ; Sun, 6 Mar 2016 19:48:19 +0000 (UTC) Received: by mail-ob0-f180.google.com with SMTP id ts10so89757013obc.1 for ; Sun, 06 Mar 2016 11:48:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=DgTyyeuECtXDDMW5AIj89Cq4d9Rx0lEnV/3lNN2UPL0=; b=v8LVXoFlJfsYhf1F3edwmZxqKv621p9yQXuWdVb2dmhWvuWkYD7cfhNf0NXrc5HbUV B8O+rHhCXmc+jsv4+bH1ykJ8A/RpkddgnS8lkpCn7nuongnqOZdrft/lRouHmAWlWqDN MwxaBjBNtbZjX4ap7mgazEGQF9yi+qgwdLeX0YsapF4yGOXQZWVEhh2Jo4oz17F/XmJw n/aY6ffhAlU/rA7h6zmhrq6jZzCFqrXvxtG0PAXc4XWj8gSVFQHTNhmsbZBw5dj1dRZf s84Rrn1ZBgwGaip+EFKcW5cQW/wI0/aX15JRniRoaHgZ3kkbcbOBK/lUEaBB0y6PSqGZ zKYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=DgTyyeuECtXDDMW5AIj89Cq4d9Rx0lEnV/3lNN2UPL0=; b=W08VxgkUkdD03VbX1kZYNk0qQwd9R7d7Prft8ioYHRYzlOpXuQb9efmCHHwfOIOCEo gP7NaSOtKVSjiMb7I4jZrcCklIZSmcgT68vr0QLX4JkotzPd2eW2VhkweD+U53z16OAl mt4GV1spEydZ2wsXfCqIX/t/vSLM7GUvLVkEbuRzonVmwE/9hixTrJsegzLz3ySPOSbY Xg4WW2UoRW1B1IAZ7GobFWdAYSNt8aYkRvEgAAAzTuWbhvwWOCSeJe6Zz3zr7GV/jDs3 4Yc+z9XeV5JiTRGrt/Cncsr9iR9GYUj3SykUjj5XgAsc9SRadFCAy9derhKqxXuyMcbm p+DQ== X-Gm-Message-State: AD7BkJIHqzFEmNkOG56nmPo1ZJ2yeaTnjjZzMjM8Gj8h2AEQxIZddq2dcvN0JetnopkX8qktt8/nHf7kcR/izw== X-Received: by 10.182.110.198 with SMTP id ic6mr12764635obb.15.1457293698439; Sun, 06 Mar 2016 11:48:18 -0800 (PST) MIME-Version: 1.0 Received: by 10.202.243.4 with HTTP; Sun, 6 Mar 2016 11:47:58 -0800 (PST) In-Reply-To: References: From: =?UTF-8?Q?Jos=C3=A9_Luis_Larroque?= Date: Sun, 6 Mar 2016 16:47:58 -0300 Message-ID: Subject: Re: Redefine yarn.application.classpath value To: Dejan Menges Cc: "common-user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=089e0112c0da3a9f4a052d66a122 --089e0112c0da3a9f4a052d66a122 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Dejan, thanks for your answer and sorry for taking too long to response. I have this line in yarn-env.sh: export YARN_CONF_DIR=3D"${YARN_CONF_DIR:-$HADOOP_YARN_HOME/conf}" I changed to export YARN_CONF_DIR=3D${HADOOP_CONF_DIR} But it didn't change anything. I also take a look at $HADOOP_HOME/etc/hadoop searching for HADOOP_CONF_DIR, as you already suggested Dejan, and i founded this on hadoop-env.sh: export HADOOP_CONF_DIR=3D${HADOOP_CONF_DIR:-"/usr/local/hadoop/etc/hadoop"} Those are the only ocurrences that i could find. I'm starting to believe that i'm making some huge mistake, because i keep modifyng configuration files and the command *yarn classpath* is always showing me the same output. Please, any help would be really appreciated !! Bye! Jose 2016-02-07 6:21 GMT-03:00 Dejan Menges : > Hello Jose, > > For Yarn's classpath, depending how you installed everything on Ubuntu, > take a look also into yarn-env.sh, and inside > /etc/default/${whateveryarnorhadoopfile}. > > However, I would personally expect it to be in yarn-env.sh. > > Cheers > > On Sun, Feb 7, 2016 at 2:02 AM Jos=C3=A9 Luis Larroque > wrote: > >> In SO someone recommend me this: >> >> "check the place where you are setting $HADOOP_CONF_DIR, you might be >> setting that multiple places.. The $HADOOP_CONF_DIR is added by the >> bin/hadoop script to the front of the path. " >> >> i'm setting it on hadoop-env.sh: >> export >> HADOOP_CONF_DIR=3D${HADOOP_CONF_DIR:-"/usr/local/hadoop/etc/hadoop"} >> >> But it isn't working, the classpath remains the same. I tried removing >> it, but was the same anyway. >> >> Please!!! any help would be greatly appreciated. >> >> Bye! >> Jose >> >> 2016-01-30 13:42 GMT-03:00 Jos=C3=A9 Luis Larroque : >> >>> Hi guys! >>> >>> i have a Ubuntu 14.04 LTS, with a hadoop 2.4.0 single node cluster. Whe= n >>> i execute yarn classpath on console, gives me this: >>> >>> /usr/local/hadoop/etc/hadoop:/usr/local/hadoop/etc/hadoop:/usr/local/ha= doop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hado= op/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/had= oop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/loca= l/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr= /local/hadoop/share/hadoop/mapreduce/lib/*:/usr/local/hadoop/share/hadoop/m= apreduce/*:/usr/local/hadoop/contrib/capacity-scheduler/*.jar:/usr/local/ha= doop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/* >>> >>> As you can see, the first value is repeated three times. I looked for a >>> way to redefine or reset this. The only way, as far as i know, it's >>> redefining a property in yarn-site.xml, like this: >>> >>> >>> Classpath for typical applications. >>> yarn.application.classpath >>> >>> $HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/share/hadoop/common/*, $H= ADOOP_COMMON_HOME/share/hadoop/common/lib/*, $HADO$ >>> >>> >>> >>> But yarn.application.classpath remains the same, without changes, even >>> if i stop every process of hadoop and start them all again. What other >>> option do i have? i'm doing something wrong here? >>> >> >> --089e0112c0da3a9f4a052d66a122 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Dejan, thanks for your answer and sorry = for taking too long to response.

I have this line in yarn= -env.sh:
export YARN_CONF_DIR=3D"${YARN_CONF_DIR:-$HADOOP_YARN_HOME= /conf}"

I changed to
export YARN_CONF_DIR=3D${HA= DOOP_CONF_DIR}

But it didn't change anything.

I also take a look at $HADOOP_HOME/etc/hadoop searchi= ng for HADOOP_CONF_DIR, as you already suggested Dejan, and i founded this = on hadoop-env.sh:
export HADOOP_CONF_DIR=3D${HADOOP_CONF_DIR:-"/usr= /local/hadoop/etc/hadoop"}

Those are the only ocurre= nces that i could find.

I'm starting= to believe that i'm making some huge mistake, because i keep modifyng = configuration files and the command yarn classpath is always showing= me the same output.

Please, any help would be reall= y appreciated !!

Bye!
Jose
<= div class=3D"gmail_extra">
2016-02-07 6:21 GM= T-03:00 Dejan Menges <dejan.menges@gmail.com>:
Hello Jose,

F= or Yarn's classpath, depending how you installed everything on Ubuntu, = take a look also into yarn-env.sh, and inside /etc/default/${whateveryarnor= hadoopfile}.

However, I would personally expect it= to be in yarn-env.sh.=C2=A0

Cheers

On Sun, Feb 7, 2016 at 2:02 AM Jos=C3=A9 Luis Larroque <larroquester@gmail.co= m> wrote:
<= div>
In SO someone recommend me this:

"check the plac= e where you are setting $HADOOP_CONF_DIR, you might be setting= that multiple places.. The $HADOOP_CONF_DIR is added by the b= in/hadoop script to the front of the path. "

=20 =20 =20 =20 =20 =20 i'm setting it on hadoop-env.sh:
= =C2=A0export HADOOP_CONF_DIR=3D${HADOOP_CONF_DIR:-"/usr/local/ha= doop/etc/hadoop"}

But it isn't working, the classpath remains the same. I t= ried removing it, but was the same anyway.

Please!!! any = help would be greatly appreciated.

Bye!
Jose

2016-01-30 13:4= 2 GMT-03:00 Jos=C3=A9 Luis Larroque <larroquester@gmail.com>:
Hi guys!
=

i have a Ubuntu 14.04 LTS, with a hadoop 2.4.0 single node c= luster. When i execute yarn classpath on console, gives me thi= s: 
/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/etc/hadoop:/usr/l=
ocal/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/loc=
al/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/hdfs:/usr/lo=
cal/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/u=
sr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/yarn=
/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*:/usr/local/hadoop/share/h=
adoop/mapreduce/*:/usr/local/hadoop/contrib/capacity-scheduler/*.jar:/usr/l=
ocal/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*

As you can see, the first value is repeated three times. I looked for a way to redefine or reset this. The only way, as far as i know, it's= =20 redefining a property in yarn-site.xml, like this:

 <property>
    <description>Classpath for typical applications.</description&=
gt;
     <name>yarn.application.classpath</name>
        <value>
        $HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/share/hadoop/common/*, $HADOO=
P_COMMON_HOME/share/hadoop/common/lib/*, $HADO$
     </value>
  </property>

But yarn.application.classpath remains the same, without changes, even if i stop every process of hadoop and start them all=20 again. What other option do i have? i'm doing something wrong here?

=


--089e0112c0da3a9f4a052d66a122--