drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-6126) Allocate memory for value vectors upfront in flatten operator
Date Wed, 21 Feb 2018 20:10:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371935#comment-16371935
] 

ASF GitHub Bot commented on DRILL-6126:
---------------------------------------

Github user ppadma commented on the issue:

    https://github.com/apache/drill/pull/1125
  
    @paul-rogers Paul, will you be able to review this ?


> Allocate memory for value vectors upfront in flatten operator
> -------------------------------------------------------------
>
>                 Key: DRILL-6126
>                 URL: https://issues.apache.org/jira/browse/DRILL-6126
>             Project: Apache Drill
>          Issue Type: Improvement
>            Reporter: Padma Penumarthy
>            Assignee: Padma Penumarthy
>            Priority: Critical
>             Fix For: 1.12.0
>
>
> With recent changes to control batch size for flatten operator, we figure out row count
in the output batch based on memory. Since we know how many rows we are going to include in
the batch, we can also allocate the memory needed upfront instead of starting with initial
value (4096) and doubling, copying every time we need more. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message