drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abdel Hakim Deneche <adene...@maprtech.com>
Subject Re: Empty parquet file creation and use in Drill
Date Fri, 18 Mar 2016 05:08:08 GMT
Drill used to create such empty parquet files, but we would get an
exception when we try to query them (DRILL-3635

Drill's current behavior when you do a CTAS with a LIMIT 0 query is to not
write anything to disk, then when you try to query the table you would get
a "table not found" error message.

On Fri, Mar 18, 2016 at 2:53 AM, Khurram Faraaz <kfaraaz@maprtech.com>

> Hello All,
> Currently in Drill 1.7.0 we do not support,
>   - the creation of empty parquet files.
>   - and we see an Exception when empty parquet file is queried using Drill
> Should we support the creation of empty parquet file that just has the
> metadata information in the parquet footer and no actual data (consider the
> CTAS case that uses a LIMIT 0 query)
> Once such an empty parquet file is created, Drill should also be able to
> query that parquet file, and report to user that there are no rows to
> return.
> Thanks,
> Khurram


Abdelhakim Deneche

Software Engineer


Now Available - Free Hadoop On-Demand Training

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message