Mailing-List: contact dev-help@hawq.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hawq.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: <CAH=zMbpuTin+GG_YyZL4qxNzezXHm5YV-+rgm0Dsm-eUcvu3Lw@mail.gmail.com>
References: <cf36c1bc-eb76-419c-ab92-71c246b6d078.kuien.lke@alibaba-inc.com>
 <81a063c8-9cc0-464a-93f6-b7126c4efd49.kuien.lke@alibaba-inc.com>
 <CAE44UQeC=wH=0mPQ_aQApv5nB63a+Hw3A0s5fdDSC_aABYzPEQ@mail.gmail.com> <CAH=zMbpuTin+GG_YyZL4qxNzezXHm5YV-+rgm0Dsm-eUcvu3Lw@mail.gmail.com>
From: Yi JIN <jinyi.apache@gmail.com>
Date: Fri, 1 Dec 2017 14:10:36 +1100
Message-ID: <CAEUT=QuTMRBnnVKFj-7avbwP-6z_mnkqf0qcYK+b7Spvs6qX_Q@mail.gmail.com>
Subject: Re: Apache HAWQ (incubating) 2.3.0.0 suggestion
To: dev@hawq.incubator.apache.org
Cc: =?UTF-8?B?5YiY5aWO5oGpKOWxgOWklik=?= <kuien.lke@alibaba-inc.com>
Content-Type: multipart/alternative; boundary="94eb2c042bdc72e5f0055f3eb62c"
archived-at: Fri, 01 Dec 2017 03:10:49 -0000

--94eb2c042bdc72e5f0055f3eb62c
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi Radar,

According to my input, the pluggable storage framework is one desired
feature from marketing, as it is key to reenforce HAWQ performance
advantages and its code is nowunder refactor for delivery as I have seen
some activities relating to this feature, I think we just need the last
mile to have it contributed in Apache HAWQ. Therefore, I prefer to give
more patience to have one stronger release besides those amazing features
we have done, like TDE, ranger etc. Thanks.

Best,
Yi

On Thu, Nov 30, 2017 at 8:45 PM, Radar Lei <rlei@pivotal.io> wrote:

> Hi All,
>
> As Ed mentioned, we already have sufficient content(TDE, Ranger
> HA/Kerberos) to do a release, and seems Pluggable storage feature need mo=
re
> time to finish review and tests.
>
> So  how about we do this release without pluggable storage? We can make
> another release soon if pluggable storage is ready for production, any
> comments? Thanks.
>
>
> Regards,
> Radar
>
> On Wed, Nov 15, 2017 at 8:44 AM, Lei Chang <chang.lei.cn@gmail.com> wrote=
:
>
> > Cool. Looks your guys' work is quite related to the pluggable storage
> > feature (HAWQ-786).
> >
> > The feature implements a native C interface for external formats and it
> is
> > several times faster than the current JAVA interface. And the feature h=
as
> > been validated in Oushu version for some time.
> >
> > If you guys are interested in the alignment of the feature, we can
> discuss
> > it on the JIRA.
> >
> > Cheers
> > Lei
> >
> >
> >
> >
> > On Tue, Nov 14, 2017 at 2:02 PM, =E5=88=98=E5=A5=8E=E6=81=A9(=E5=B1=80=
=E5=A4=96) <kuien.lke@alibaba-inc.com>
> > wrote:
> >
> > >
> > > Missed out DEV.
> > >
> > > ------------------------------------------------------------------
> > > =E5=8F=91=E4=BB=B6=E4=BA=BA=EF=BC=9A=E5=88=98=E5=A5=8E=E6=81=A9(=E5=
=B1=80=E5=A4=96) <kuien.lke@alibaba-inc.com>
> > > =E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4=EF=BC=9A2017=E5=B9=B411=E6=9C=88=
14=E6=97=A5(=E6=98=9F=E6=9C=9F=E4=BA=8C) 11:15
> > > =E6=94=B6=E4=BB=B6=E4=BA=BA=EF=BC=9ALei Chang <chang.lei.cn@gmail.com=
>
> > > =E4=B8=BB =E9=A2=98=EF=BC=9A=E5=9B=9E=E5=A4=8D=EF=BC=9AApache HAWQ (i=
ncubating) 2.3.0.0 suggestion
> > >
> > > Hi Dr. Chang,
> > >
> > > Good, thanks for useful suggestion. Now there is:
> > > https://issues.apache.org/jira/browse/HAWQ-1550
> > >
> > > We are trying to integrate Hawq engine onto MaxCompute (former name
> > ODPS, within
> > > Aliyun Cloud), Seahawks, it is led by Mr. Chen Xia. We develop a
> > component
> > > AXF (borrow idea from PXF) to connect data sources from Druid and
> > > MaxCompute, it works well for this 11.11 battle, but it is not
> > stand-alone
> > > program.
> > >
> > > -------------=E2=80=94=E2=80=94
> > > Kuien Liu/=E5=A5=8E=E6=81=A9
> > >
> > > ------------------------------------------------------------------
> > > =E5=8F=91=E4=BB=B6=E4=BA=BA=EF=BC=9ALei Chang <chang.lei.cn@gmail.com=
>
> > > =E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4=EF=BC=9A2017=E5=B9=B411=E6=9C=88=
14=E6=97=A5(=E6=98=9F=E6=9C=9F=E4=BA=8C) 10:28
> > > =E6=94=B6=E4=BB=B6=E4=BA=BA=EF=BC=9Adev <dev@hawq.incubator.apache.or=
g>; =E5=88=98=E5=A5=8E=E6=81=A9(=E5=B1=80=E5=A4=96) <
> > > kuien.lke@alibaba-inc.com>
> > > =E4=B8=BB =E9=A2=98=EF=BC=9ARe: Apache HAWQ (incubating) 2.3.0.0 sugg=
estion
> > >
> > >
> > > Kuien, we are welcoming any good contributions from the community.
> > >
> > > Looks hawq_log_master_concise is a good enhancement, I'd like suggest
> you
> > > create a JIRA and we can discuss it on the JIRA.
> > >
> > > Can you explain more about Druid Wrapper & MaxCompute Wrapper? What a=
re
> > > the use cases here?
> > >
> > > Cheers
> > > Lei
> > >
> > >
> > >
> > >
> > >
> > > On Tue, Nov 14, 2017 at 10:05 AM, =E5=88=98=E5=A5=8E=E6=81=A9(=E5=B1=
=80=E5=A4=96) <kuien.lke@alibaba-inc.com>
> > > wrote:
> > > Hi Ed and Hawq,
> > > I have add two GUCs (log_max_size, log_max_age) to control the logfil=
e
> > > size on master, otherwise the query to hawq_toolkit.hawq_log_master_
> > concise
> > > will be slower and slower, and disk usage on master is hard to
> constrain.
> > > If some gys are interested to this, I can submit it to Hawq.
> > > Besides, our team has introduced many interesting features on hawq, b=
ut
> > > most of them are deep coupling with Alibaba Cloud. Some of them may b=
e
> > > (maybe not) seperated alone, such as Druid Wrapper, MaxCompute
> Wrapper. I
> > > will discuss with teammates Mr. Chen Xia, Mr. Zhiyong Dai et al.
> > >
> > > =E7=A5=9D=E5=A5=BD=EF=BC=81=E5=88=98=E5=A5=8E=E6=81=A9/=E5=B1=80=E5=
=A4=96
> > > ------------------------------------------------------------
> ------=E5=8F=91=E4=BB=B6=E4=BA=BA=EF=BC=9AEd
> > > Espino <espino@apache.org>=E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4=EF=BC=
=9A2017=E5=B9=B411=E6=9C=8813=E6=97=A5(=E6=98=9F=E6=9C=9F=E4=B8=80) 23:25=
=E6=94=B6=E4=BB=B6=E4=BA=BA=EF=BC=9Adev <
> > > dev@hawq.incubator.apache.org>=E4=B8=BB =E9=A2=98=EF=BC=9AApache HAWQ=
 (incubating) 2.3.0.0
> > > suggestion
> > > HAWQ,
> > >
> > > I feel we have sufficient content to warrant a 2.3.0.0
> > > release. It has been
> > > 4+ months since our last release (2.2.0.0). I suggest we include the
> > > pluggable storage feature (HAWQ-786 - assigned to Chiyang Wan -
> > > chiyang10000@gmail.com) plus others (as appropriate) in
> > > the 2.3.0.0 queue in
> > > the next release.
> > >
> > > Are there any outstanding issues that are mandatory for
> > > the 2.3.0.0 release?
> > > What do others think?
> > >
> > > -=3De
> > >
> > > --
> > > *Ed Espino*
> > >
> > >
> > >
> > >
> >
>

--94eb2c042bdc72e5f0055f3eb62c--