drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5815) Provide option to set query memory as percent of total
Date Wed, 04 Oct 2017 04:39:02 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190798#comment-16190798
] 

ASF GitHub Bot commented on DRILL-5815:
---------------------------------------

Github user paul-rogers commented on a diff in the pull request:

    https://github.com/apache/drill/pull/960#discussion_r142579551
  
    --- Diff: exec/java-exec/src/main/resources/drill-module.conf ---
    @@ -240,7 +240,7 @@ drill.exec: {
         }
       },
       sort: {
    -    purge.threshold : 1000,
    +    purge.threshold: 1000,
    --- End diff --
    
    Rebased onto master and resolved the merge conflict in favor of Tim's change.


> Provide option to set query memory as percent of total
> ------------------------------------------------------
>
>                 Key: DRILL-5815
>                 URL: https://issues.apache.org/jira/browse/DRILL-5815
>             Project: Apache Drill
>          Issue Type: Improvement
>    Affects Versions: 1.11.0
>            Reporter: Paul Rogers
>            Assignee: Paul Rogers
>             Fix For: 1.12.0
>
>
> Drill provides a parameter to set the memory per query as a static number which defaults
to 2 GB. This number is a wonderful setting for the default Drillbit configuration of 8 GB
heap; it allows 2-3 concurrent queries. But, as Drillbit memory increases, the default becomes
a bit constraining. While users can change the setting, they seldom do.
> In addition, provide an option that sets memory as a percent of total memory. If the
allocation is 10%, say, and total memory is 128 GB, then each query gets ~13GB, which is a
big improvement.
> The existing option acts as a floor: the query must receive at least that much memory.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message