drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jim Scott <jsc...@maprtech.com>
Subject Re: Parquet file partition size
Date Mon, 08 Sep 2014 15:32:45 GMT
I have created tables with Drill in parquet format and it created 2 files.


On Fri, Sep 5, 2014 at 3:46 PM, Jim <jimfcarroll@gmail.com> wrote:

>
> Actually, it looks like it always breaks it into 6 pieces by default. Is
> there a way to make the partition size fixed rather than the number of
> partitions?
>
>
> On 09/05/2014 04:40 PM, Jim wrote:
>
>> Hello all,
>>
>> I've been experimenting with drill to load data into Parquet files. I
>> noticed rather large variability in the size of each parquet chunk. Is
>> there a way to control this?
>>
>> The documentation seems a little sparse on configuring some of the finer
>> details. My apologies if I missed something obvious.
>>
>> Thanks
>> Jim
>>
>>
>


-- 
*Jim Scott*
Director, Enterprise Strategy & Architecture

 <http://www.mapr.com/>
[image: MapR Technologies] <http://www.mapr.com>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message