asterixdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wail Alkowaileet <wael....@gmail.com>
Subject Re: Modified/Custom plan: Push-down SELECT for external source.
Date Sat, 27 Aug 2016 15:39:21 GMT
Cool.
Thanks Yingyi!

On Sat, Aug 27, 2016 at 1:58 AM, Yingyi Bu <buyingyi@gmail.com> wrote:

> Currently you can push Project into the source but not Select.
> You're welcome to enhance IMetedataProvider to support that.  You can take
> a look at DataSourceScanPOperator:
>
> Pair<IOperatorDescriptor, AlgebricksPartitionConstraint> p =
> mp.getScannerRuntime(dataSource, vars,
>         projectVars, scan.isProjectPushed(), scan.getMinFilterVars(),
> scan.getMaxFilterVars(), opSchema,
>         typeEnv, context, builder.getJobSpec(), implConfig);
>
>
> Best,
>
> Yingyi
>
>
> On Fri, Aug 26, 2016 at 3:44 PM, Wail Alkowaileet <wael.y.k@gmail.com>
> wrote:
>
> > Hi AsterixDBers.
> >
> > Is there any easy way to push-down filter to an external source (in my
> case
> > Parquet) without being too intrusive ?
> >
> > This can perform way faster than STREAM-SELECT, as parquet can
> potentially
> > skip Row Groups while scanning.
> > --
> >
> > *Regards,*
> > Wail Alkowaileet
> >
>



-- 

*Regards,*
Wail Alkowaileet

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message