arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wes McKinney <wesmck...@gmail.com>
Subject Re: Proposed new type: Fixed width list
Date Wed, 13 Jul 2016 00:19:00 GMT
I'm +1 on this. I've seen fixed-width strings and other things in many
different contexts. I would say that fixed-width binary is probably
the primary use case, but you could imaging casting int96 data to
fixed_list<3, int32>

On Mon, Jul 11, 2016 at 11:24 PM, Micah Kornfield <emkornfield@gmail.com> wrote:
> This came up in a code review a while ago, but what do people think of
> adding a fixed width list type to the memory layout spec.
>
> This would have the same layout as the current list type.  Instead of
> having a separate offset buffer to determine location and length of
> each list, the length would be stored as part of metadata and offsets
> would be calculated using multiplication instead of lookups.
>
> One use case for this is an easy mapping to the "FIXED_LEN_BYTE_ARRAY"
> in parquet.
>
> If people like the idea I can file a JIRA and update the current layout.md.
>
> Thanks,
> -Micah

Mime
View raw message