drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-6126) Allocate memory for value vectors upfront in flatten operator
Date Tue, 06 Mar 2018 23:01:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388668#comment-16388668

ASF GitHub Bot commented on DRILL-6126:

Github user ppadma commented on the issue:

    @paul-rogers Thank you Paul. I will be incorporating some of your suggestions in future
PRs. This change will allow us to build more things on top. 

> Allocate memory for value vectors upfront in flatten operator
> -------------------------------------------------------------
>                 Key: DRILL-6126
>                 URL: https://issues.apache.org/jira/browse/DRILL-6126
>             Project: Apache Drill
>          Issue Type: Improvement
>            Reporter: Padma Penumarthy
>            Assignee: Padma Penumarthy
>            Priority: Critical
>             Fix For: 1.12.0
> With recent changes to control batch size for flatten operator, we figure out row count
in the output batch based on memory. Since we know how many rows we are going to include in
the batch, we can also allocate the memory needed upfront instead of starting with initial
value (4096) and doubling, copying every time we need more. 

This message was sent by Atlassian JIRA

View raw message