hawq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jon Roberts <jrobe...@pivotal.io>
Subject Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Date Mon, 03 Apr 2017 14:53:45 GMT
JDBC PXF is pretty exciting.  Are there details on how this works?

Does PXF randomly pick a segment to connect to the JDBC source or do you
specify a particular node to execute the query?  I'm assuming it isn't a
parallel query so you don't flood the JDBC source with x number of "select
*" queries but I could be wrong.

How do you register the JDBC connection string with PXF?

How do you manage credentials?

How do you register the JDBC jar files?


Jon Roberts

On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <espino@apache.org> wrote:

> Thank you Michael, this is a well-deserved report highlight. I have added
> the following to the report:
>
>   3. Community contribution highlight(s):
>
>      * Leveraging the extensible PXF design, a JDBC PXF plugin
>        was contributed by Devin Jia (github id: jiadexin). This
>        contribution came from the community and not from the
>        company which originally donated HAWQ to the ASF.
>
> Warm regrds,
> -=e
>
> On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> michael.andre.pearce@me.com> wrote:
>
> >
> > I would add note about the new JDBC PXF plugin being contributed by Devin
> > Jia. (Kudos to him)
> >
> > It's a good show of the community contributing and growing outside of
> just
> > Pivotal staff (I think for incubator review this is important) and also
> the
> > benefit of the extensible PXF design the project has done.
> >
> > On 1 Apr 2017, at 18:05, Ed Espino <espino@apache.org> wrote:
> >
> > Paul,
> >
> > Thank you for the input.  I have added your suggestions to the report.
> >
> > Cheers,
> > -=e
> >
> > On Sat, Apr 1, 2017 at 2:55 AM, Paul Guo <paulguo@gmail.com> wrote:
> >
> >> Maybe we could include the change for the doc and homepage into the
> >> report?
> >> We have an open source doc now and the home page is more friendly to
> >> users.
> >>
> >> 2017-04-01 13:52 GMT+08:00 Ed Espino <espino@apache.org>:
> >>
> >>> Lili,
> >>>
> >>> I have updated the report. Thank you for the contributions.
> >>>
> >>> -=e
> >>>
> >>> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lma@pivotal.io> wrote:
> >>>
> >>>> Hi Ed,
> >>>>
> >>>> The Apache HAWQ website has been updated to provide clearer
> >>>>      access to download release artifacts.
> >>>>
> >>>> We also updated the website to add more information:
> >>>> 1. Add more community activities and recorded videos:
> >>>> https://cwiki.apache.org/confluence/display/HAWQ/Community
> >>>> 2. Add design documents for certain components:
> >>>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
> >>>>
> >>>> Thanks
> >>>> Lili
> >>>>
> >>>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <espino@apache.org>
wrote:
> >>>>
> >>>> > Ruilong,
> >>>> >
> >>>> > Thanks buddy.  January 123!!!  :) a typo indeed. I have updated
the
> >>>> report.
> >>>> >
> >>>> > -=e
> >>>> >
> >>>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rhuo@pivotal.io>
> wrote:
> >>>> >
> >>>> > > Hi Ed,
> >>>> > >
> >>>> > > One typo is that HAWQ Meetup is on January 12, 2017.
> >>>> > >
> >>>> > > Best regards,
> >>>> > > Ruilong Huo
> >>>> > >
> >>>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <espino@apache.org>
> >>>> wrote:
> >>>> > >
> >>>> > > > Team HAWQ,
> >>>> > > >
> >>>> > > > Below is the draft ASF HAWQ Incubator PMC report for
April 2017,
> >>>> > covering
> >>>> > > > Q1 2017 activity.
> >>>> > > >
> >>>> > > > It is posted at http://wiki.apache.org/incubator/April2017
> >>>> > > >
> >>>> > > > Please let me know if you have any comments or suggestions
and I
> >>>> will
> >>>> > > update
> >>>> > > > the report.
> >>>> > > >
> >>>> > > > Regards,
> >>>> > > > -=e
> >>>> > > >
> >>>> > > > --
> >>>> > > > *Ed Espino*
> >>>> > > >
> >>>> > > >
> >>>> > > > --------------------
> >>>> > > > HAWQ
> >>>> > > >
> >>>> > > > Apache HAWQ is a Hadoop native SQL query engine that
combines
> the
> >>>> key
> >>>> > > > technological advantages of MPP database with the scalability
> and
> >>>> > > > convenience
> >>>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS
> >>>> natively.  HAWQ
> >>>> > > > delivers industry-leading performance and linear scalability.
It
> >>>> > provides
> >>>> > > > users the tools to confidently and successfully interact
with
> >>>> petabyte
> >>>> > > > range
> >>>> > > > data sets. HAWQ provides users with a complete, standards
> >>>> compliant SQL
> >>>> > > > interface.
> >>>> > > >
> >>>> > > > HAWQ has been incubating since 2015-09-04.
> >>>> > > >
> >>>> > > > Three most important issues to address in the move towards
> >>>> graduation:
> >>>> > > >
> >>>> > > >   1. Continue to improve the project's release cadence.
To this
> >>>> end we
> >>>> > > >      plan on expanding automation services to support
increased
> >>>> > > >      developer participation.
> >>>> > > >
> >>>> > > >   2. Continue to expand the community, by adding new
> contributors
> >>>> and
> >>>> > > >      focusing on making sure that there's a much more
robust
> >>>> level of
> >>>> > > >      conversations and discussions happening around roadmaps
and
> >>>> > > >      feature development on the public dev mailing list.
> >>>> > > >
> >>>> > > >   3. Expand release artifacts to include the delivery
of binary
> >>>> > > >      artifacts. We expect the project to significantly
refine
> the
> >>>> > > >      binary release process in several key areas.
> >>>> > > >
> >>>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board
wish/need
> >>>> to be
> >>>> > > > aware of?
> >>>> > > >
> >>>> > > >   1. Nothing urgent at this time.
> >>>> > > >
> >>>> > > > How has the community developed since the last report?
> >>>> > > >
> >>>> > > >   1. Two Meetups took place in Beijing, China:
> >>>> > > >
> >>>> > > >      * HAWQ Meetup (January 123, 2017)
> >>>> > > >
> >>>> > > >        - HAWQ2.X New Features - Yanqing Wen, Pivotal
HAWQ Senior
> >>>> > > >          Engineer
> >>>> > > >        - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior
> >>>> Engineer
> >>>> > > >        - Data Lake and HAWQ Integration - Wenbin Lu,
EMC Big
> Data
> >>>> > > >          Senior Engineer
> >>>> > > >
> >>>> > > >      * HAWQ Meetup (March 23, 2017)
> >>>> > > >
> >>>> > > >        - Apache HAWQ Exploration Step by Step - Configuration,
> >>>> Build,
> >>>> > > >          Deployment and Debug by Xiang Sheng, Pivotal
Software
> >>>> > > >          Engineer
> >>>> > > >        - Transaction Management in Apache HAWQ by Ming
Li,
> Pivotal
> >>>> > > >          Senior Software Engineer
> >>>> > > >        - Max Compute - A SQL engine based on Apache HAWQ
by Chen
> >>>> Xia,
> >>>> > > >          Database Expert in Alibaba Cloud
> >>>> > > >
> >>>> > > >   2. A significant push by the dev community has been
made to
> >>>> review
> >>>> > > >      and merge the project's Pull Requests (PR). As of
March 30,
> >>>> 2017,
> >>>> > > >      eight of the nine open PRs have been opened in the
last ten
> >>>> > > >      days. The PR opened on Sep 2016 is targeted to be
merged
> >>>> after
> >>>> > > >      the Apache 2.2.0.0 release.
> >>>> > > >
> >>>> > > >   3. Recent porting efforts:
> >>>> > > >
> >>>> > > >      - Persistent Systems Engineers are actively engaging
the
> dev
> >>>> > > >        community on their HAWQ porting efforts to RHEL
7.1 on
> S390
> >>>> > > >        platform.
> >>>> > > >
> >>>> > > >      - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes
have been
> >>>> > > >        published on dev list.
> >>>> > > >
> >>>> > > >   4. Ruilong Huo has volunteered to be the Release Manager
(RM)
> >>>> for
> >>>> > > >      the upcoming 2.2.0.0 release
> >>>> > > >
> >>>> > > > How has the project developed since the last report?
> >>>> > > >
> >>>> > > >   1. Apache HAWQ 2.1.0.0 (source code only) has been
released.
> >>>> > > >
> >>>> > > >   2. Apache HAWQ 2.2.0.0 release proposed (source code
and first
> >>>> > > >      binary release).  This is the 3rd release as an
incubating
> >>>> > > >      project.
> >>>> > > >
> >>>> > > >      Release page:
> >>>> > > >
> >>>> > > >        https://cwiki.apache.org/confluence/display/HAWQ/
> >>>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
> >>>> > > >
> >>>> > > >      Release hightlights:
> >>>> > > >
> >>>> > > >        * CentOS 7.x Support
> >>>> > > >        * Ranger Integration
> >>>> > > >        * PXF ORC Profile
> >>>> > > >        * Bug Fixes
> >>>> > > >
> >>>> > > >   3. Paul Guo (paulguo@gmail.com - committer and recent
HAWQ
> PPMC
> >>>> > > >      member) is publishing (to dev email list) a regular
HAWQ
> >>>> > Graduation
> >>>> > > > update for the
> >>>> > > >      project.
> >>>> > > >
> >>>> > > >      * HAWQ graduation update (January, 17, 2017)
> >>>> > > >        https://lists.apache.org/thread.html/
> >>>> > > cd37e2b48d4bbc9fe4a9cea47f8247
> >>>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> >>>> > > >
> >>>> > > >      * Apache HAWQ graduation update (Mar 1st, 2017)
> >>>> > > >        https://lists.apache.org/thread.html/
> >>>> > > 3a1e454f8c706dd71b1690c3ae74a1
> >>>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> >>>> > > >
> >>>> > > >   4. The Apache HAWQ website has been updated to provide
clearer
> >>>> > > >      access to download release artifacts.
> >>>> > > >
> >>>> > > > How would you assess the podling's maturity?
> >>>> > > > Please feel free to add your own commentary.
> >>>> > > >
> >>>> > > >   [ ] Initial setup
> >>>> > > >   [ ] Working towards first release
> >>>> > > >   [X] Community building
> >>>> > > >   [X] Nearing graduation
> >>>> > > >   [ ] Other:
> >>>> > > >
> >>>> > > > Date of last release:
> >>>> > > >
> >>>> > > >   2017-02-28
> >>>> > > >
> >>>> > > > When were the last committers or PMC members elected?
> >>>> > > >
> >>>> > > >   Podling committers (3) added:
> >>>> > > >     Lisa Owen: January 31, 2017
> >>>> > > >     Jane Beckman: February 1, 2017
> >>>> > > >     Kyle Dunn: March 2, 2017
> >>>> > > >
> >>>> > > >   PPMC member (1) added:
> >>>> > > >     Paul Guo: March 10, 2017
> >>>> > > >
> >>>> > > > Signed-off-by:
> >>>> > > >
> >>>> > > >  [ ](hawq) Alan Gates
> >>>> > > >            Comments:
> >>>> > > >  [ ](hawq) Konstantin Boudnik
> >>>> > > >            Comments:
> >>>> > > >  [ ](hawq) Justin Erenkrantz
> >>>> > > >            Comments:
> >>>> > > >  [ ](hawq) Thejas Nair
> >>>> > > >            Comments:
> >>>> > > >  [ ](hawq) Roman Shaposhnik
> >>>> > > >            Comments:
> >>>> > > >
> >>>> > > > IPMC/Shepherd notes:
> >>>> > > >
> >>>> > > >
> >>>> > > >
> >>>> > >
> >>>> >
> >>>> >
> >>>> >
> >>>> > --
> >>>> > *Ed Espino*
> >>>> >
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>> *Ed Espino*
> >>>
> >>
> >>
> >
> >
> > --
> > *Ed Espino*
> >
> >
>
>
> --
> *Ed Espino*
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message