drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5457) Support Spill to Disk for the Hash Aggregate Operator
Date Fri, 26 May 2017 16:37:04 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16026477#comment-16026477

ASF GitHub Bot commented on DRILL-5457:

Github user rchallapalli commented on the issue:

    And based on my initial testing, I observed that the hash-agg is only using half of the
memory allocated. Since the planner by default uses a 2-phase agg, the memory computation
logic divides the allocated memory between the 2 hash-agg operators in the plan. This is grossly
in-efficient. And every test written would need to be modified once this issue gets resolved.
Hence I would push for a fix sooner than later

> Support Spill to Disk for the Hash Aggregate Operator
> -----------------------------------------------------
>                 Key: DRILL-5457
>                 URL: https://issues.apache.org/jira/browse/DRILL-5457
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Execution - Relational Operators
>    Affects Versions: 1.10.0
>            Reporter: Boaz Ben-Zvi
>            Assignee: Boaz Ben-Zvi
>             Fix For: 1.11.0
> Support gradual spilling memory to disk as the available memory gets too small to allow
in memory work for the Hash Aggregate Operator.

This message was sent by Atlassian JIRA

View raw message