arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brian Bowman <Brian.Bow...@sas.com>
Subject Need 64-bit Integer length for Parquet ByteArray Type
Date Fri, 05 Apr 2019 17:22:54 GMT
All,

SAS requires support for storing varying-length character and binary blobs with a 2^64 max
length in Parquet.   Currently, the ByteArray len field is a unint32_t.   Looks this the will
require incrementing the Parquet file format version and changing ByteArray len to uint64_t.

Have there been any requests for this or other Parquet developments that require file format
versioning changes?

I realize this a non-trivial ask.  Thanks for considering it.

-Brian
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message