drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Padma Penumarthy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-6126) Allocate memory for value vectors upfront in flatten operator
Date Wed, 07 Mar 2018 02:49:00 GMT

     [ https://issues.apache.org/jira/browse/DRILL-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Padma Penumarthy updated DRILL-6126:
------------------------------------
    Labels: ready-to-commit  (was: )

> Allocate memory for value vectors upfront in flatten operator
> -------------------------------------------------------------
>
>                 Key: DRILL-6126
>                 URL: https://issues.apache.org/jira/browse/DRILL-6126
>             Project: Apache Drill
>          Issue Type: Improvement
>            Reporter: Padma Penumarthy
>            Assignee: Padma Penumarthy
>            Priority: Critical
>              Labels: ready-to-commit
>             Fix For: 1.12.0
>
>
> With recent changes to control batch size for flatten operator, we figure out row count
in the output batch based on memory. Since we know how many rows we are going to include in
the batch, we can also allocate the memory needed upfront instead of starting with initial
value (4096) and doubling, copying every time we need more. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message