drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boaz Ben-Zvi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-5385) Vector serializer fails to read saved SV2
Date Fri, 28 Apr 2017 23:35:04 GMT

     [ https://issues.apache.org/jira/browse/DRILL-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Boaz Ben-Zvi updated DRILL-5385:
    Labels: ready-to-commit  (was: )

> Vector serializer fails to read saved SV2
> -----------------------------------------
>                 Key: DRILL-5385
>                 URL: https://issues.apache.org/jira/browse/DRILL-5385
>             Project: Apache Drill
>          Issue Type: Bug
>    Affects Versions: 1.8.0
>            Reporter: Paul Rogers
>            Assignee: Paul Rogers
>              Labels: ready-to-commit
>             Fix For: 1.11.0
> Drill provides the {{VectorAccessibleSerializable}} class to write a record batch to
a stream, and to read that batch from a stream. Record batches can carry an indirection vector
(a so-called selection vector 2 or SV2).
> The code to write batches writes the SV2 to the stream. But, the code to deserialize
batches initializes, but does not read, the SV2 from the stream.
> The result is that vector deserialization reads the wrong bytes and the saved values
are corrupted on read.
> Note that this issue was found via unit testing. At present, the only production use
of this code is in the external sort, which serializes batches without an indirection vector.

This message was sent by Atlassian JIRA

View raw message