Return-Path: X-Original-To: apmail-bigtop-user-archive@www.apache.org Delivered-To: apmail-bigtop-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 24CA918E1E for ; Tue, 15 Mar 2016 08:10:19 +0000 (UTC) Received: (qmail 42334 invoked by uid 500); 15 Mar 2016 08:10:19 -0000 Delivered-To: apmail-bigtop-user-archive@bigtop.apache.org Received: (qmail 41940 invoked by uid 500); 15 Mar 2016 08:10:18 -0000 Mailing-List: contact user-help@bigtop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@bigtop.apache.org Delivered-To: mailing list user@bigtop.apache.org Received: (qmail 41919 invoked by uid 99); 15 Mar 2016 08:10:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Mar 2016 08:10:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 826871804D3 for ; Tue, 15 Mar 2016 08:10:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id qA4J4R9-mXP7 for ; Tue, 15 Mar 2016 08:10:15 +0000 (UTC) Received: from mail-wm0-f50.google.com (mail-wm0-f50.google.com [74.125.82.50]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id CC9755FAD1 for ; Tue, 15 Mar 2016 08:10:14 +0000 (UTC) Received: by mail-wm0-f50.google.com with SMTP id l68so132689299wml.0 for ; Tue, 15 Mar 2016 01:10:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=GpTfHdTCtNzT3CWIaxkKGjI09AgZx7FdIZcWZVO8Iss=; b=1AAofsCkZvqCtPZgxspKbvHk0PofKL86pm3VDs+2HPaxRw10YtcLgEwE6IxcFIjfJ+ 7g84gq6NX/s3idcgJGeeRyQRaxhQMphxSeIZp4QBLhaD04tNMQhHJB2ILwwVEbkqOZzw h2nASVe8WFfkCsxiFAMgbOfyyhQ5UOOsv6yC44lgIkmaaHOcyJyHJwN5f/6J1xHHP6U2 9ANICT0q7NmrT1cEFeQVJPF9Eg0q6kOFLZuWosOU3Ul3Kb1DvtolMiwqvoGtKQTaWGw+ szCFd8lX8kNRPmH37hDTfl4iBu9j3Pw3H2l+ndVGD10UMcztOv4w/xpUGfwCeKbT6epb pozg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=GpTfHdTCtNzT3CWIaxkKGjI09AgZx7FdIZcWZVO8Iss=; b=iR45qrse5AuonhOVbKj+6Ij+TkWlQ0hFd7A1i63ENdzpCPck7farkpC4mbFInomZla u0LkWdSQwZhdGCBlgXdFnw30DrBRokkDE7sAKkex2vdgUfx5jsOVftCvQSNlYpXlSTvA s9lInLNuRaV6ZkfYQE+pwOWZf76icXwl6frkiU6h6H3H86PS3GgfEKUF/a3q6g07S1aE mXIdIivkhTl/kZI9fTOc2VgYAnZ8f0/KEzIlWFR7xkmYtQCl4rl5bOFAMQhx2C0X6qLz +pgMziQedX+sqNRDJcl4L0aTOQfTszjF701D3i8X1RDa/P4Jo3GKQOSgmTypDrt0Uqis HNoA== X-Gm-Message-State: AD7BkJIMAicZN1HPwCuk7w4brT9I4idUDVrBr/Rw6FNkVcsRpR5Kv4I7nUOqb58E0PVTyr8ZUK+bUkARoDfOrw== MIME-Version: 1.0 X-Received: by 10.28.171.8 with SMTP id u8mr21340874wme.97.1458029414511; Tue, 15 Mar 2016 01:10:14 -0700 (PDT) Received: by 10.28.47.199 with HTTP; Tue, 15 Mar 2016 01:10:14 -0700 (PDT) In-Reply-To: References: <20160308181125.GA10860@tpx> <1B72D95D-FA30-4697-9A2E-9155B80D88B9@gmail.com> Date: Tue, 15 Mar 2016 09:10:14 +0100 Message-ID: Subject: Re: User guide? From: David Starina To: "user@bigtop.apache.org" Content-Type: multipart/alternative; boundary=001a11450b0453019b052e11edc7 --001a11450b0453019b052e11edc7 Content-Type: text/plain; charset=UTF-8 Hi guys, me again. I haven't set up Puppet before, can you just point me in the right direction? I know this is not a Puppet mailing list, but I bet you have some tips for me :-) So what do I need to do? Install Puppet on every node? What does it mean that the mode of Puppet is "*masterless"* - do I just have to do a basic installation of Puppet and not care much about setting it up, and then deploy bigtop on every node separately? And when setting the Hadoop head node - does that mean that I need to deploy Bigtop on this node first, and Bigtop will know this is the master node by the url or IP I provide to it? And then deploy Bigtop via Puppet on all the other nodes and they will connect to the head node (which is the NameNode, I suppose?). I can do this via trial and error, but if you guys can help me reduce the "error" part, that will be great :) Sorry for such beginner questions, I haven't used Puppet before ... The reason I'm asking is, I got access to a "physical" (actually virtual, but it's the same) environment for a limited amount of time (two weeks), and I need to start testing on it asap - and since my day job takes a lot of my time, if I wanted to do this without help it could take me two weeks just to set up the environment - but I need to install it, which is not the central part of my project, and then run some ML algorithms on a text corpus, which will be the main part of the project ... --David On Thu, Mar 10, 2016 at 11:28 AM, David Starina wrote: > Thanks for the info! > > --David > > On Tue, Mar 8, 2016 at 7:15 PM, Jay Vyas > wrote: > >> I think there is enough info on youtube that you can cobble together a >> syllabus if you need structured learning. >> >> See cos/Romans Bigtop talks which are on YouTube and then my Bigtop >> internals hackathon video. That gives you both the high and low level >> details to do whatever you want. >> >> > On Mar 8, 2016, at 1:11 PM, Konstantin Boudnik wrote: >> > >> > We also had this discussion to start producing "The Big Book of Apache >> > Bigtop" like HBase does, but never got into the materialization part of >> that >> > project. >> > >> > Cos >> > >> >> On Tue, Mar 08, 2016 at 11:44PM, Evans Ye wrote: >> >> Hi David, >> >> >> >> If you just want to take Bigtop binaries to deploy a cluster, you can >> refer >> >> to our puppet management recipes: >> >> https://github.com/apache/bigtop/tree/master/bigtop-deploy/puppet >> >> >> >> BTW bigtop provisioner is the best source to reference for how bigtop >> >> provision a cluster: >> >> >> https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+Provisioner+User+Guide >> >> >> >> Please ask us if you find anything confusing. >> >> >> >> >> >> Evans >> >> >> >> >> >> >> >> 2016-03-08 0:48 GMT+08:00 David Starina : >> >> >> >>> Hi, >> >>> >> >>> Is there some version of Bigtop User Guide available? I know it used >> to be >> >>> on the be on http://bigtop.apache.org/ under the "User Guide" link, >> but >> >>> there's nothing there anymore ... >> >>> >> >>> I need some guide on how to install Bigtop on a physical cluster ... >> It >> >>> was easy to create a virtual cluster on my machine using Vagrant, but >> I >> >>> cannot find a manual to install on a physical cluster ... >> >>> >> >>> Cheers, >> >>> David >> >>> >> > > --001a11450b0453019b052e11edc7 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi guys,

me again. I have= n't set up Puppet before, can you just point me in the right direction?= I know this is not a Puppet mailing list, but I bet you have some tips for= me :-)

So what do I need to do? Install Puppet on every node?= What does it mean that the mode of Puppet is "masterless" - do I just have to do a basic installation of Puppet and not care much = about setting it up, and then deploy bigtop on every node separately? And w= hen setting the Hadoop head node - does that mean that I need to deploy Big= top on this node first, and Bigtop will know this is the master node by the= url or IP I provide to it? And then deploy Bigtop via Puppet on all the ot= her nodes and they will connect to the head node (which is the NameNode, I = suppose?).

I can do this via trial and error, but if you guys = can help me reduce the "error" part, that will be great :) Sorry = for such beginner questions, I haven't used Puppet before ... The reaso= n I'm asking is, I got access to a "physical" (actually virtu= al, but it's the same) environment for a limited amount of time (two we= eks), and I need to start testing on it asap - and since my day job takes a= lot of my time, if I wanted to do this without help it could take me two w= eeks just to set up the environment - but I need to install it, which is no= t the central part of my project, and then run some ML algorithms on a text= corpus, which will be the main part of the project ...

--Dav= id

On Th= u, Mar 10, 2016 at 11:28 AM, David Starina <david.starina@gmail.com<= /a>> wrote:
Thanks for the info!
<= br>
--Dav= id

On Tue, Mar 8, 2016 at 7:1= 5 PM, Jay Vyas <jayunit100.apache@gmail.com> wrote= :
I think there is enough info on youtube= that you can cobble together a syllabus if you need structured learning.
See cos/Romans Bigtop talks which are on YouTube and then my Bigtop interna= ls hackathon video.=C2=A0 =C2=A0That gives you both the high and low level = details to do whatever you want.

> On Mar 8, 2016, at 1:11 PM, Konstantin Boudnik <cos@apache.org> wrote:
>
> We also had this discussion to start producing "The Big Book of A= pache
> Bigtop" like HBase does, but never got into the materialization p= art of that
> project.
>
> Cos
>
>> On Tue, Mar 08, 2016 at 11:44PM, Evans Ye wrote:
>> Hi David,
>>
>> If you just want to take Bigtop binaries to deploy a cluster, you = can refer
>> to our puppet management recipes:
>> https://github.com/apache/= bigtop/tree/master/bigtop-deploy/puppet
>>
>> BTW bigtop provisioner is the best source to reference for how big= top
>> provision a cluster:
>> https://cwi= ki.apache.org/confluence/display/BIGTOP/Bigtop+Provisioner+User+Guide >>
>> Please ask us if you find anything confusing.
>>
>>
>> Evans
>>
>>
>>
>> 2016-03-08 0:48 GMT+08:00 David Starina <david.starina@gmail.com>:
>>
>>> Hi,
>>>
>>> Is there some version of Bigtop User Guide available? I know i= t used to be
>>> on the be on http://bigtop.apache.org/ under the "Use= r Guide" link, but
>>> there's nothing there anymore ...
>>>
>>> I need some guide on how to install Bigtop on a physical clust= er ... It
>>> was easy to create a virtual cluster on my machine using Vagra= nt, but I
>>> cannot find a manual to install on a physical cluster ...
>>>
>>> Cheers,
>>> David
>>>


--001a11450b0453019b052e11edc7--