arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Kornfield <>
Subject Re: Access Schema from ArrowReader in Java
Date Thu, 08 Oct 2020 04:18:10 GMT
I think this is probably because the schema is transformed for Dictionary
encoded fields [1].  Something could probably be done to expose the schema
separately, but the library and readers are mostly designed around
populating and repopulating VectorSchemaRoots, so I don't think the extra
cost was considered.  What type of bottlenecks is this causing for you?

If you would like to open a PR or further discuss dev@ might be a better
place to discuss use-case and design of the feature you are looking for.



On Wed, Oct 7, 2020 at 12:34 PM Michael Mior <> wrote:

> Why is the Schema object not exposed in ArrowReader? (e.g. readSchema
> is protected). Instead, I need to call
> getVectorSchemaRoot().getSchema() which unnecessarily allocates a
> VectorSchemaRoot that I don't immediately need.
> --
> Michael Mior

View raw message