Mailing-List: contact user-help@bigtop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@bigtop.apache.org
Received-SPF: pass (athena.apache.org: domain of steven.nunez@illation.com
 designates 74.115.204.51 as permitted sender)
From: =?Windows-1252?Q?Steven_N=FA=F1ez?= <steven.nunez@illation.com>
To: "user@bigtop.apache.org" <user@bigtop.apache.org>
CC: "dev@bigtop.apache.org" <dev@bigtop.apache.org>
Subject: Re: Cluster Management: OpenSource & Vendor Options
Thread-Topic: Cluster Management: OpenSource & Vendor Options
Thread-Index: AQHPBXy0DNksEo3YYk2jPZnamDzi9Jpuuf6A//+OXQCAANzqgIAAr/gA
Date: Wed, 1 Jan 2014 14:50:58 +0000
Message-ID: <CEE9770F.22DF2%steve.nunez@illation.com>
References: <CEE6EE1F.22C3A%steve.nunez@illation.com>
 <CAHP56HcpK8LQq_ArzOTB2obEktS5AzQPQYWN8HVhZ7tyuG5Now@mail.gmail.com>
 <CEE82AEB.22CE4%steve.nunez@illation.com> <20131231212105.GA559@tpx>
In-Reply-To: <20131231212105.GA559@tpx>
Accept-Language: en-AU, en-US
Content-Language: en-US
Content-Type: text/plain; charset="Windows-1252"
Content-ID: <8EA1899F0DA83945AC91C0E1B743F111@domain.local>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

I can=B9t comment on the direction of Ambari, nor CM=B9s internals, but a g=
ood
set of Hadoop command-line management tools, based on puppet, chef or
salt, would certainly be a good addition to the community, regardless of
BigTop supporting Ambari. Especially since it allows easy integration into
existing data centre administration & operations processes.

If sufficiently mature, a thin GUI shouldn=B9t be that hard to add for
common operations. The question is: where does this fit? In BigTop as a
sub-project? A project in and of itself? It=B9s not a trivial amount of
work, and Ambari might just be the =8Cgood enough=B9 path of least resistan=
ce;
at least being open source some hooks could be added to support
orchestration tools.

	- SteveN


On 2013-12-31 14:21 , "Konstantin Boudnik" <cos@apache.org> wrote:

>The reason for not-much activity on that JIRA is because Ambari seems to
>be
>drifting away from real-life orchestration systems like Puppet toward
>something else. And that's exactly why I prefer to use Puppet or Chef
>orchestration - you have a state machine that works in the same way on
>every
>supported platform.
>
>In 20 years of doing system and network administration as well as software
>development I've seen times and again how the fancy UI applications fail
>to
>deliver on their promise. Main reason is in the shifting of the focus on
>the
>bling instead of the core functionality.
>
>Cloudera's CM is a perfect example of my point, because it is doing
>totally
>heinous things with standard Linux services, their life-cycle and
>configurations up to the point where any sane Hadoop devops would be
>helpless
>to do anything without CM. Ambrai seems to be a bit better in this
>respect.
>However, with the development above and replacement of the Puppet I am not
>sure how much longer it will be the case.
>
>Happy New Year everyone!
>  Cos
>
>On Tue, Dec 31, 2013 at 03:10PM, Steven N=FA=F1ez wrote:
>> Thanks. That issue answers pretty much all the questions. I=B9d certainl=
y
>>give
>> it a +1 if I had a login. That definitely seems like the right
>>direction to
>> move in. I don=B9t know the internals, but if everyone is using BigTop f=
or
>> packaging, perhaps there=B9s some way to read the manifest files (if
>>that=B9s
>> what they=B9re called) to produce what Ambari needs for management.
>>=20
>>=20
>> From: Chris Mildebrandt
>><chris@woodenrhino.com<mailto:chris@woodenrhino.com>>
>> Reply-To: "user@bigtop.apache.org<mailto:user@bigtop.apache.org>"
>><user@bigtop.apache.org<mailto:user@bigtop.apache.org>>
>> Date: Tuesday, 31 December 2013 7:57
>> To: "user@ambari.apache.org<mailto:user@ambari.apache.org>"
>><user@ambari.apache.org<mailto:user@ambari.apache.org>>
>> Cc: "user@bigtop.apache.org<mailto:user@bigtop.apache.org>"
>><user@bigtop.apache.org<mailto:user@bigtop.apache.org>>
>> Subject: Re: Cluster Management: OpenSource & Vendor Options
>>=20
>> You may want to watch this:
>>https://issues.apache.org/jira/browse/AMBARI-3524
>>=20
>> and include it in your write-up for future considerations. Though there
>>hasn't been much activity on it.
>>=20
>> On Mon, Dec 30, 2013 at 8:32 AM, Steven N=FA=F1ez
>><steven.nunez@illation.com<mailto:steven.nunez@illation.com>> wrote:
>> Seasons Greetings All,
>>=20
>> I=B9m doing a bit of a write-up on the various Hadoop distributions and
>>would like to understand exactly what packages are installed by the
>>Apache version of Ambari. It=B9s an exciting place to be working (big dat=
a
>>& Hadoop) but the lines are blurred in many ways. The way I see the open
>>source landscape now is something like this (from a
>>management/installation/configuration perspective):
>>=20
>> BigTop -> RPM like packaging for Hadoop
>> Ambari -> GUI management/monitoring/provisioning
>>=20
>> Looking at it from a vendor perspective, we=B9ve got (I know there are
>>others, this is just for discussion):
>>=20
>> BigTop (packaging)
>> CDH
>> HDP
>> Apache Bigtop
>>=20
>> Cloudera
>> Cloudera Manager (closed source, commercial)
>>=20
>> Hortonworks / Apache
>> Ambari(open source)
>>=20
>> The CDH, BigTop and HDP (I assume) base distributions require a lot of
>>manual configuration, so the best way to spin up a cluster with a
>>reasonable set of applications (say HDFS, YARN, Hive, HCatalog, HBase,
>>ZooKeeper, Oozie, Pig, Sqoop) is to use CDH + CM or Ambari + HDP.
>>=20
>> Is there an equivalent for Apache? If I use the kit found at
>>ambari.apache.org<http://ambari.apache.org> to spin up a cluster, do I
>>get Apache components, or the HDP distribution? I=B9m trying to define th=
e
>>=8CApache distribution=B9 in my mind, if there is one, and understand
>>exactly what its capabilities are, and cluster management is rather
>>fundamental, since not many folks have the luxury of spending time
>>climbing the long, steep learning curve of Hadoop ecosystem
>>configuration.
>>=20
>> Cheers,
>> - SteveN
>>=20
>>=20
>>=20