Mailing-List: contact dev-help@hawq.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hawq.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: <CA+ULb+scCF2ZxhS=ATmGGkO4Av0gvE3ht9V7q=jaNrWY+eUeyg@mail.gmail.com>
References: <CALpJHBD+ypq_5PHtn_iyyJwx8Y7fn3h3c+9_3KVkUAt7aFEbSw@mail.gmail.com>
 <CA+ULb+scCF2ZxhS=ATmGGkO4Av0gvE3ht9V7q=jaNrWY+eUeyg@mail.gmail.com>
From: Hubert Zhang <hzhang@pivotal.io>
Date: Thu, 7 Jul 2016 11:07:54 +0800
Message-ID: <CAB0yrenkVNmgjHRBsJNk89TaXdWfg-3Mx6Qio5HdrzupWVvhHA@mail.gmail.com>
Subject: Re: [Propose] New PXF profile optimized for ORC (predicate pushdown)
To: dev@hawq.incubator.apache.org
Content-Type: multipart/alternative; boundary=001a1142d3dc0e81a8053702feb7
archived-at: Thu, 07 Jul 2016 03:08:03 -0000

--001a1142d3dc0e81a8053702feb7
Content-Type: text/plain; charset=UTF-8

+1 for lazy reader, It can save a lot of decompression and
deserialization(CPU bound) time.

On Wed, Jul 6, 2016 at 7:00 AM, Roman Shaposhnik <roman@shaposhnik.org>
wrote:

> On Tue, Jul 5, 2016 at 12:01 PM, Shivram Mani <shivram.mani@gmail.com>
> wrote:
> > I've created the following jira HAWQ-866
> > <https://issues.apache.org/jira/browse/HAWQ-886> which is focussed on
> > improving/enhancing the existing PXF profile to read ORC files. The goal
> is
> > to make use of the underlying ORC reader's capability of supporting
> > predicate push-down among others.
> >
> > Presto has also contributed an alternative ORC reader which provides both
> > predicate push down and Lazy reads
> >
> https://code.facebook.com/posts/370832626374903/even-faster-data-at-the-speed-of-presto-orc/
> > .
> >
> > Will be evaluating both the options as part of this effort.
>
> Great to see this effort! Do you plan to come up with any kind of
> benchmark to
> be able to compare the native ORC reader vs. PXF ORC reader performance
> and capabilities?
>
> Or does it really all just boil down to TPC?
>
> Thanks,
> Roman.
>


-- 
Thanks

Hubert Zhang

--001a1142d3dc0e81a8053702feb7--