drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Rogers (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5385) Vector serializer fails to read saved SV2
Date Sat, 25 Mar 2017 20:57:41 GMT
Paul Rogers created DRILL-5385:

             Summary: Vector serializer fails to read saved SV2
                 Key: DRILL-5385
                 URL: https://issues.apache.org/jira/browse/DRILL-5385
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.8.0
            Reporter: Paul Rogers
            Assignee: Paul Rogers
             Fix For: 1.11.0

Drill provides the {{VectorAccessibleSerializable}} class to write a record batch to a stream,
and to read that batch from a stream. Record batches can carry an indirection vector (a so-called
selection vector 2 or SV2).

The code to write batches writes the SV2 to the stream. But, the code to deserialize batches
initializes, but does not read, the SV2 from the stream.

The result is that vector deserialization reads the wrong bytes and the saved values are corrupted
on read.

Note that this issue was found via unit testing. At present, the only production use of this
code is in the external sort, which serializes batches without an indirection vector.

This message was sent by Atlassian JIRA

View raw message