hawq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jon Roberts <jrobe...@pivotal.io>
Subject Re: Impact on HAWQ when used with Multi-Homed Nodes
Date Wed, 08 Feb 2017 16:16:46 GMT
That is a bit different request.  Let's say we have VLAN1 and VLAN2 where
VLAN1 is where regular applications are located and intranet traffic and
VLAN2 is the private cloud used by Hadoop.  The HAWQ Master servers,
located in VLAN2, will also need to be connected to VLAN1.  By default, the
Masters listen on all IP addresses on the hosts so you'll be able to
connect to the database with TPC on port 5432.  The Hadoop data nodes and
HAWQ Segments do not need to be connected to VLAN2.

The statement "HAWQ nodes need to listen on both VLAN's" is incorrect.
Only the Masters need to be listen on both VLANs.

If you are familiar with Greenplum, it would be just like separating the
Interconnect traffic from the intranet traffic.



Jon Roberts
Principal Engineer | jroberts@pivotal.io | 615-426-8661

On Wed, Feb 8, 2017 at 10:03 AM, Dino Bukvic <dbukvic@pivotal.io> wrote:

> Hi Lei,
>
> I am not sure that NIC bonding is possible in this case.
> Please see this statement email from the customer:
> "The reason the HAWQ/Hadoop solution needs to be connected to two separated
> VLAN’s is because it is used from our private cloud and our regular
> applications.
> Both have their own VLAN’s which are not routable to each other. This means
> the HAWQ nodes need to listen on both VLAN’s from a separated NIC."
>
> I am aware that there are binding parameters in YARN, HDFS, MR, HBASE that
> would support his case. How would HAWQ master need to be configured to
> listen to both NICs if they are not bonded?
>
> Regards,
>
> Dino Bukvic *|* Advisory Solutions Architect *|* PDE EMEA *|* Pivotal
> *mail *dbukvic@pivotal.io *web* www.pivotal.io
> *mobile* +49 (0)152 03459731
>
> GoPivotal Deutschland GmbH
> Hauptverwaltung und Sitz: Am Kronberger Hang 2a, 65824 Schwalbach/Ts.
> Registergericht: Amtsgericht Königstein im Taunus, HRB 8433
> Geschäftsführer: Andrew Michael Cohen, Paul Thomas Dacier
>
> <http://www.pivotal.io/>
>
>
> >
> > ---------- Forwarded message ----------
> > From: Lei Chang <lei_chang@apache.org>
> > To: dev <dev@hawq.incubator.apache.org>
> > Cc:
> > Date: Wed, 8 Feb 2017 17:58:13 +0800
> > Subject: Re: Impact on HAWQ when used with Multi-Homed Nodes
> > Hi Dino,
> >
> > HAWQ 2.x needs NIC bonding. If there is no NIC bonding, only 1 NIC will
> be
> > used.
> >
> > Thanks
> > Lei
> >
> >
> > On Tue, Feb 7, 2017 at 7:17 PM, Dino Bukvic <dbukvic@pivotal.io> wrote:
> >
> > > Hi all,
> > >
> > > We have a customer who is setting up 2 NICs on all cluster nodes that
> are
> > > configured to be in different VLANs which are not routable to each
> other.
> > >
> > > Will this have an impact on HAWQ when running (master and segments) on
> > > those nodes?
> > >
> > >
> > > Thanks in advance.
> > >
> > > Regards,
> > > Dino Bukvic *|* Advisory Solutions Architect *|* PDE EMEA *|* Pivotal
> > > *mail *dbukvic@pivotal.io *web* www.pivotal.io
> > > *mobile* +49 (0)152 03459731
> > >
> > > GoPivotal Deutschland GmbH
> > > Hauptverwaltung und Sitz: Am Kronberger Hang 2a, 65824 Schwalbach/Ts.
> > > Registergericht: Amtsgericht Königstein im Taunus, HRB 8433
> > > Geschäftsführer: Andrew Michael Cohen, Paul Thomas Dacier
> > >
> > > <http://www.pivotal.io/>
> > >
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message