arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Li Jin <ice.xell...@gmail.com>
Subject Re: Best way to create/set validity bitmap buffer in Java
Date Tue, 03 Jan 2017 23:42:13 GMT
To answer myself: the above doesn't work because mutator doesn't update
writerIndex (only ArrowBuf.writeXXX does).

Still wondering if there is a good way of setting validity map in Java?

Li

On Tue, Jan 3, 2017 at 5:11 PM, Li Jin <ice.xelloss@gmail.com> wrote:

> Hi,
>
> I am working on a function where I want to create an arrow record batch
> from Spark dataset. I am curious what's the best way to create validity
> bitmap buffer for a field?
>
> I found BitVector which has a mutator
> <https://github.com/apache/arrow/blob/master/java/vector/src/main/java/org/apache/arrow/vector/BitVector.java#L425>
that
> seems to do the thing I want, I am wondering should I:
>
> (1) create a BitVector
> (2) set the value in the BitVector using the mutator
> (3) pass the ArrowBuf from the BitVector
> <https://github.com/apache/arrow/blob/45ed7e7a36fb2a69de468c41132b6b3bbd270c92/java/vector/src/main/java/org/apache/arrow/vector/BaseDataValueVector.java#L116>
to
> the record batch?
>
> Thanks,
> Li
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message