Mailing-List: contact bigtop-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: bigtop-dev@incubator.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <CA+ULb+vj0XA5=kmXMv=akg4yNrOU6Na-pcH74x=9Um9MetyOvQ@mail.gmail.com>
References: 
 <CA+ULb+v0t2A6NF2A7BuoNQnT1G1JniVy1+dMVK3hSg_z1R-EAA@mail.gmail.com>
 <CAHfHakEOk=YDW3yExNQKNHJozxWdu8cutnuNmp3Jp1dUC=94ZQ@mail.gmail.com>
 <CA+ULb+vj0XA5=kmXMv=akg4yNrOU6Na-pcH74x=9Um9MetyOvQ@mail.gmail.com>
From: Matt Foley <mfoley@hortonworks.com>
Date: Wed, 2 May 2012 11:44:44 -0700
Message-ID: 
 <CA+z3+9FZ9KPgAxt8PAKgmd-DC=PyPMQT8wsfdO0SX6O25D3fxA@mail.gmail.com>
Subject: Re: Guarding against the use of upstream scripts
To: bigtop-dev@incubator.apache.org
Content-Type: multipart/alternative; boundary=e0cb4efe2f2c7eccd204bf121662

--e0cb4efe2f2c7eccd204bf121662
Content-Type: text/plain; charset=ISO-8859-1

What is the justification for saying "what we are doing in BigTop", when it
is diverging from what has been done for years in the Components?  It seems
that this is carelessly discarding what is being practiced at a lot of
sites, because you'd rather do it this way.  Generally speaking, we make
the Hadoop Ecosystem easier to use by adhering to familiar usage, rather
than diverging.  Please give reasons for the divergence.

Thanks,
--Matt

On Wed, May 2, 2012 at 11:31 AM, Roman Shaposhnik <rvs@apache.org> wrote:

> On Wed, May 2, 2012 at 11:01 AM, Owen O'Malley <omalley@apache.org> wrote:
> > On Wed, May 2, 2012 at 8:34 AM, Roman Shaposhnik <rvs@apache.org> wrote:
> >> Guys,
> >>
> >> I've noticed lately that new users of the Bigtop distro fall prey
> >> to thinking that they can simply utilized upstream launcher scripts
> >> as is by running them from under /usr/lib/<component>bin
> >> directories. Something this works. More often it doesn't.
> >
> > This will break users in two ways:
>
> Just to be clear (and sorry for not being specific in the original email):
> this
> only applies to trunk e.g. Hadoop 2.X based Bigtop.
>
> > 1. Many user scripts use $HADOOP_HOME/bin/X to find script X.
>
> Not sure I understand how this applies to Hadoop 2.X codeline.
> HADOOP_HOME has been deprecated there and in fact now
> that we have split the sub-projects it no longer makes even a
> backward-compatibility sense to maintain the illusion.
>
> > 2. Until those scripts are available in other locations, there is no
> > choice. For users that want to manage the servers manually, having
> > access to the hadoop-daemon.sh is required. Of course, it should be in
> > /usr/sbin/hadoop-daemon.sh, but until it is of course the users needs
> > to reference it in $HADOOP_HOME/sbin/hadoop-daemon.sh.
>
> Right, but the Bigtop layout is completely different anyway. It has
> very little to do with the upstream Hadoop 2.X layout.
>
> Please consider this in the context of what we are doing in Bigtop,
> not what happens with upstream Hadoop.
>
> Thanks,
> Roman.
>

--e0cb4efe2f2c7eccd204bf121662--