Mailing-List: contact dev-help@hawq.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hawq.incubator.apache.org
Date: Tue, 5 Dec 2017 14:10:09 +0000 (UTC)
From: chang.lei.cn@gmail.com
To: dev@hawq.incubator.apache.org,  <dev@hawq.incubator.apache.org>
Cc: user <user@hawq.incubator.apache.org>
Message-ID: <5590DB2387FAB413.678770E1-ED29-40CE-902F-61C9EED1FECC@mail.outlook.com>
In-Reply-To: <D1511A5A-9DFC-4B04-A5C2-9D0F3B7FF8CF@ig.com>
References: <CAHAuQDyOuiFfNL0ZLHk2Gwjj-gyt1f_QRLi0ZbZ=mXSLT7uTiQ@mail.gmail.com>
 <CAE44UQf-ZBr+F6ATshzcYxzz2+Kq5-0qQ=0+W990jBtKYNHsEA@mail.gmail.com>
 <D1511A5A-9DFC-4B04-A5C2-9D0F3B7FF8CF@ig.com>
Subject: Re: Questions for HAWQ dev community: Pluggable storage formats and
 files systems vs. PXF
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_4243_1186701515.1512483009495"
archived-at: Tue, 05 Dec 2017 14:10:25 -0000

------=_Part_4243_1186701515.1512483009495
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable


=09
=09=09
=09=09
=09
=09=09Mike, =C2=A0the new framework will include all the plugins for extern=
al data.=20
ThanksLei

=09=09
=09=09

=09=09CheersLei
=09


On Tue, Dec 5, 2017 at 5:30 PM +0800, "Michael Pearce" <Michael.Pearce@ig.c=
om> wrote:


Lei,

I would disagree. The Jira / feature doesn=E2=80=99t cater for integration =
with other Hadoop components or other sources such as HBase etc, it simply =
seems to cover storage of internal data.

As such I wouldn=E2=80=99t like to see a component maintained in apache for=
 Apache Hawq, moved out of Apache ownership and governance.

It should remain whilst still core to HAWQ in this ASF project.

Regards
Mike

On 05/12/2017, 01:19, "Lei Chang"  wrote:

    Great to see Greenplum is using PXF. I think PXF is a very good fit for
    Greenplum's current architecture.

    To avoid duplicate maintenance cost, my suggestion is to only maintain =
PXF
    code in one place: Greenplum.

    From HAWQ side, it can be deprecated in a future release after the new
    framework is ready.

    Thanks
    Lei


    On Tue, Dec 5, 2017 at 3:02 AM, Ed Espino  wrote:

    > To the HAWQ dev community,
    >
    > I wanted to raise up an issue for discussion regarding JIRA HAWQ-786
    > . This is a proposal for a
    > new component/functionality (Framework to support pluggable formats a=
nd
    > file systems) that appears to replace that currently provided by the =
PXF
    > component.
    >
    > PXF was recently re-used in another open source project: Greenplum-DB=
 (
    > https://github.com/greenplum-db/gpdb/tree/5X_STABLE/gpAux/extensions/=
pxf )
    > and depends on the server-side components that exist today in HAWQ=E2=
=80=99s source
    > tree.
    >
    > The question I have for the community is: with the possibility of PXF=
 being
    > replaced by a new component in a future release of HAWQ, what should =
become
    > of the PXF code? Older releases of HAWQ (2.3.0 >) will continue to us=
e it
    > but there is an outside project now depending on it.
    >
    > Does the HAWQ community want to maintain the PXF code in the HAWQ pro=
ject
    > or if not here, where? If the GPDB community forked PXF from HAWQ wou=
ld
    > that be ok?
    >
    > Regards,
    >
    > Ed Espino
    >


The information contained in this email is strictly confidential and for th=
e use of the addressee only, unless otherwise indicated. If you are not the=
 intended recipient, please do not read, copy, use or disclose to others th=
is message or any attachment. Please also notify the sender by replying to =
this email or by telephone (+44(020 7896 0011) and then delete the email an=
d any copies of it. Opinions, conclusion (etc) that do not relate to the of=
ficial business of this company shall be understood as neither given nor en=
dorsed by it. IG is a trading name of IG Markets Limited (a company registe=
red in England and Wales, company number 04008957) and IG Index Limited (a =
company registered in England and Wales, company number 01190902). Register=
ed address at Cannon Bridge House, 25 Dowgate Hill, London EC4R 2YA. Both I=
G Markets Limited (register number 195355) and IG Index Limited (register n=
umber 114059) are authorised and regulated by the Financial Conduct Authori=
ty.


------=_Part_4243_1186701515.1512483009495--