Return-Path: X-Original-To: apmail-hawq-dev-archive@minotaur.apache.org Delivered-To: apmail-hawq-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5F19818236 for ; Fri, 26 Feb 2016 05:04:03 +0000 (UTC) Received: (qmail 47308 invoked by uid 500); 26 Feb 2016 05:04:03 -0000 Delivered-To: apmail-hawq-dev-archive@hawq.apache.org Received: (qmail 47220 invoked by uid 500); 26 Feb 2016 05:04:03 -0000 Mailing-List: contact dev-help@hawq.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hawq.incubator.apache.org Delivered-To: mailing list dev@hawq.incubator.apache.org Received: (qmail 47208 invoked by uid 99); 26 Feb 2016 05:04:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Feb 2016 05:04:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 7AAFCC27AD for ; Fri, 26 Feb 2016 05:04:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.999 X-Spam-Level: X-Spam-Status: No, score=0.999 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H2=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=comcast.net Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id JGYU4VsjZJRZ for ; Fri, 26 Feb 2016 05:04:00 +0000 (UTC) Received: from resqmta-po-09v.sys.comcast.net (resqmta-po-09v.sys.comcast.net [96.114.154.168]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 40AD15F2C3 for ; Fri, 26 Feb 2016 05:03:59 +0000 (UTC) Received: from resomta-po-20v.sys.comcast.net ([96.114.154.244]) by resqmta-po-09v.sys.comcast.net with comcast id Nt2z1s0055Geu2801t3rk6; Fri, 26 Feb 2016 05:03:51 +0000 Received: from tpx ([24.130.135.131]) by resomta-po-20v.sys.comcast.net with comcast id Nt3r1s0012qGB6001t3r5A; Fri, 26 Feb 2016 05:03:51 +0000 Received: from localhost (localhost [127.0.0.1]) by tpx (Postfix) with ESMTP id C3AC921557777 for ; Fri, 26 Feb 2016 08:03:50 +0300 (MSK) Date: Thu, 25 Feb 2016 21:03:50 -0800 From: Konstantin Boudnik To: dev@hawq.incubator.apache.org Subject: Re: ssh'ing around the cluster Message-ID: <20160226050350.GY24478@tpx> Mail-Followup-To: dev@hawq.incubator.apache.org References: <20160226014020.GT24478@tpx> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="G5yIW5EaChZ5gJdA" Content-Disposition: inline In-Reply-To: X-Organization: It's something of 'Cos X-PGP-Key: http://www.boudnik.org/~cos/pubkey.asc User-Agent: Mutt/1.5.21 (2010-09-15) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20140121; t=1456463031; bh=Ibvyheg5mJipNiNoJW8FSkrmvS180YzuZKFvG9jl6aU=; h=Received:Received:Received:Date:From:To:Subject:Message-ID: MIME-Version:Content-Type; b=b9r/Pk0LIDtwtZkdthkRjlaYCZ9j5ZrReWuN6EmPR6++Z4IYNgDH2rtlzNNhWhC8D 7UhXwpwUTg5K0r8ioK5A9CpTHFHfLTnPweztg53cwILUZSFPby98LfyGmwBvVdoDfl GsKizuvuXYypcnxeFkeUvkAW4/sUu/u+CTAYXu709kopjTjI8VnV/p0snfi/MHgPvq 7Zus7eWwcf3CygZcsb4NQ4BD1I9JFWyWUTFdhJCHHpJ9QWbU16j4/M0ED0FZygiA1O zWA4yh/rEbDnthFqOhS7ujYtpOb32haHml9BLMjm1wb3/pH+2gnQ+LymvYNmaL8r07 70LHg6fMgwPcg== --G5yIW5EaChZ5gJdA Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Feb 26, 2016 at 10:53AM, Lei Chang wrote: > Hi Konstantin, >=20 > If I understand correctly, what you requested is in current hawq code bas= e. > To init hawq, "hawq init cluster" is one way, you can also use "hawq init > master" and "hawq init segment" on all cluster nodes. Master and segments > are decoupled in 2.0. Ah, nice. Let me try that. Thanks! >=20 > Cheers > Lei >=20 >=20 > On Fri, Feb 26, 2016 at 9:40 AM, Konstantin Boudnik wrot= e: >=20 > > Guys, > > > > more revelations about the way Hawq is designed to work with the service > > bootstraps, config management, and so on. Looking into hawq_ctl and > > observing > > the behavior of 'hawq init cluster' I see that a number of operations is > > intended to be initiated from presumably, a master node, and carried on= all > > the nodes of a hawq cluster via the means or ssh (or rsync). While doin= g so > > might be a convenient shortcut for the development environment, it isn'= t as > > much in a real deployment. For one, it requires password-less SSH access > > between nodes, which isn't (generally speaking) how data centers might > > operate. > > > > Perhaps a better way of separating the concerns here is to have isolated > > functions to perform only local-node operations, and a wrapper to run t= he > > same > > functionality on the all remote nodes, via ssh or else. If such split is > > done, > > then an orchestration mechanism (such as a state machine similar to Pup= pet > > or > > Chef), would execute the scripts on separate nodes in full isolation. A= nd > > if > > so desired in a dev environment, the current functionality would be > > available > > as well. > > > > Thoughts? Regards, > > Cos > > --G5yIW5EaChZ5gJdA Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iF4EAREIAAYFAlbP3LYACgkQenyFlstYjhK3ogEAtKsgAxp4qDFa/VnHg4W/kXQv Bz310bGwsI2cM9mbazcA/2BT8JZUYWESpz3tPxSNPwx5UeuqsAVMv/446lA1UVjS =yDmK -----END PGP SIGNATURE----- --G5yIW5EaChZ5gJdA--