arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Julien Le Dem <jul...@dremio.com>
Subject Re: Java-C++ integration tests -- on the home stretch
Date Mon, 21 Nov 2016 23:26:41 GMT
Great!
Looking at your PR and opening JIRAs.

On Mon, Nov 21, 2016 at 2:05 PM, Wes McKinney <wesmckinn@gmail.com> wrote:

> hi folks,
>
> After a long road, we're getting very close to having tests proving
> that the Java and C++ Arrow implementations are binary compatible --
> this will be an exciting major milestone for the project. If you
> haven't been following along recent JIRAs, the way these tests work is
> as follows:
>
> 1) Testing dataset is specified in JSON format
>
> 2) Producer library (e.g. Java) reads JSON into Arrow in-memory, then
> writes out to an Arrow file IPC binary format
>
> 3) Consumer library (e.g. C++) attempts to read both the JSON and the
> binary file yielded by the producer library. The consumer compares the
> in-memory schemas and columnar data structures and indicates whether
> they are binary-identical
>
> I found a couple initial incompatibilities in the file format
> implementations, cited here:
> https://github.com/apache/arrow/pull/211#issuecomment-262080545.
>
> Thanks
> Wes
>



-- 
Julien

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message