arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Kornfield <emkornfi...@gmail.com>
Subject Proposed new type: Fixed width list
Date Tue, 12 Jul 2016 06:24:48 GMT
This came up in a code review a while ago, but what do people think of
adding a fixed width list type to the memory layout spec.

This would have the same layout as the current list type.  Instead of
having a separate offset buffer to determine location and length of
each list, the length would be stored as part of metadata and offsets
would be calculated using multiplication instead of lookups.

One use case for this is an easy mapping to the "FIXED_LEN_BYTE_ARRAY"
in parquet.

If people like the idea I can file a JIRA and update the current layout.md.

Thanks,
-Micah

Mime
View raw message