spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Armbrust <mich...@databricks.com>
Subject Re: parquet predicate / projection pushdown into unionAll
Date Tue, 09 Sep 2014 17:46:48 GMT
On Tue, Sep 9, 2014 at 10:17 AM, Cody Koeninger <cody@koeninger.org> wrote:
>
> Is there a reason in general not to push projections and predicates down
> into the individual ParquetTableScans in a union?
>

This would be a great case to add to ColumnPruning.  Would be awesome if
you could open a JIRA or even a PR :)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message