drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5457) Support Spill to Disk for the Hash Aggregate Operator
Date Wed, 17 May 2017 21:01:06 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16014757#comment-16014757
] 

ASF GitHub Bot commented on DRILL-5457:
---------------------------------------

Github user paul-rogers commented on a diff in the pull request:

    https://github.com/apache/drill/pull/822#discussion_r117107593
  
    --- Diff: exec/java-exec/src/main/resources/drill-module.conf ---
    @@ -205,10 +225,10 @@ drill.exec: {
             // Deprecated for managed xsort; used only by legacy xsort
             threshold: 40000,
             // File system to use. Local file system by default.
    -        fs: "file:///"
    +        fs: ${drill.exec.spill.fs},
    --- End diff --
    
    Suggestion: explain what we are doing:
    
    In Drill versions prior to 1.11, only sort spilled. Starting in 1.11, other operators
spill.
    Spilling is now configured in the spill group above. For backward compatibility, existing
configuration files will still configure spilling here. Please move spill configuration to
the new group above.


> Support Spill to Disk for the Hash Aggregate Operator
> -----------------------------------------------------
>
>                 Key: DRILL-5457
>                 URL: https://issues.apache.org/jira/browse/DRILL-5457
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Execution - Relational Operators
>    Affects Versions: 1.10.0
>            Reporter: Boaz Ben-Zvi
>            Assignee: Boaz Ben-Zvi
>             Fix For: 1.11.0
>
>
> Support gradual spilling memory to disk as the available memory gets too small to allow
in memory work for the Hash Aggregate Operator.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message