drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Rogers (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5815) Provide option to set query memory as percent of total
Date Mon, 25 Sep 2017 02:21:00 GMT
Paul Rogers created DRILL-5815:

             Summary: Provide option to set query memory as percent of total
                 Key: DRILL-5815
                 URL: https://issues.apache.org/jira/browse/DRILL-5815
             Project: Apache Drill
          Issue Type: Improvement
    Affects Versions: 1.11.0
            Reporter: Paul Rogers
            Assignee: Paul Rogers
             Fix For: 1.12.0

Drill provides a parameter to set the memory per query as a static number which defaults to
2 GB. This number is a wonderful setting for the default Drillbit configuration of 8 GB heap;
it allows 2-3 concurrent queries. But, as Drillbit memory increases, the default becomes a
bit constraining. While users can change the setting, they seldom do.

In addition, provide an option that sets memory as a percent of total memory. If the allocation
is 10%, say, and total memory is 128 GB, then each query gets ~13GB, which is a big improvement.

The existing option acts as a floor: the query must receive at least that much memory.

This message was sent by Atlassian JIRA

View raw message