drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Phillips (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-1960) Automatically realloc buffers when vector runs out of space
Date Thu, 22 Jan 2015 21:39:34 GMT

     [ https://issues.apache.org/jira/browse/DRILL-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Steven Phillips updated DRILL-1960:
    Attachment: DRILL-1960.patch

> Automatically realloc buffers when vector runs out of space
> -----------------------------------------------------------
>                 Key: DRILL-1960
>                 URL: https://issues.apache.org/jira/browse/DRILL-1960
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Steven Phillips
>         Attachments: DRILL-1960.patch, DRILL-1960.patch, DRILL-1960.patch
> When reaching the end of a buffer, the current way drill handles this is for setSafe()
to return false, and then whatever operator is doing the write will send the batch, and the
redo the last record. This creates a lot of difficulty, because it sometimes requires being
able to "rewind" the input stream to replay the last record.
> The proposal is to move the handling of buffer sizing and allocation into the value vectors
themselves, making it transparent to the user of the value vector. The operators will now
no longer have to worry about the possibility that writing into a vector may fail due to lack
of space.

This message was sent by Atlassian JIRA

View raw message