drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boaz Ben-Zvi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-6027) Implement spill to disk for the Hash Join
Date Thu, 18 Jan 2018 23:29:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16331416#comment-16331416

Boaz Ben-Zvi commented on DRILL-6027:

The code changes up to now are at:  [https://github.com/apache/drill/compare/master...Ben-Zvi:HashJoinSpill]

The work includes splitting the Hash-Join work into partitions (both Build and Probe sides),
and replacing the generated code for moving rows around with the new appendRow() calls.

All the user regressions are now passing.


> Implement spill to disk for the Hash Join
> -----------------------------------------
>                 Key: DRILL-6027
>                 URL: https://issues.apache.org/jira/browse/DRILL-6027
>             Project: Apache Drill
>          Issue Type: New Feature
>          Components: Execution - Relational Operators
>    Affects Versions: 1.11.0
>            Reporter: Boaz Ben-Zvi
>            Assignee: Boaz Ben-Zvi
>            Priority: Major
>             Fix For: 1.13.0
> Implement the spill memory to disk (as needed) feature for the Hash Join operator (similar
to the prior work on the Hash Aggregate).
> A design draft document has been published:
> [https://docs.google.com/document/d/1-c_oGQY4E5d58qJYv_zc7ka834hSaB3wDQwqKcMoSAI/edit?usp=sharing]
> Functional spec is available: [https://docs.google.com/document/d/1bPAddVCRxKHxi2RjqUvISIWXNqLdbRzZT9CWmanh4h0/edit]

This message was sent by Atlassian JIRA

View raw message