drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-6076) Reduce the default memory from a total of 13GB to 5GB
Date Tue, 09 Jan 2018 00:13:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317390#comment-16317390
] 

ASF GitHub Bot commented on DRILL-6076:
---------------------------------------

GitHub user kkhatua opened a pull request:

    https://github.com/apache/drill/pull/1086

    DRILL-6076: Reduce the default memory from a total of 13GB to 5GB

    Reduce minimum memory requirements from 13GB to <= 5GB
    For this, the default need to be changed as follows:
    
    Allocation | Current | New 
    ------------|--------|------
     Heap | 4GB | 1GB 
     Direct | 8GB | 3GB 
     CodeCache | 1GB | 512MB 
     MaxPermSize | 512MB | 512MB (Ignored if JDK8+) 
     **Total** | 13.5GB | 5GB 
     **Total (JDK8+)** | 13GB | 4.5GB 


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/kkhatua/drill DRILL-6076

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/1086.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1086
    
----
commit e7d3cbf6abf904096efeea8391fc46a768e08bb8
Author: Kunal Khatua <kkhatua@...>
Date:   2018-01-05T01:49:50Z

    DRILL-6076: Reduce the default memory from a total of 13GB to 5GB
    
    Reduce minimum memory requirements from 13GB to <= 5GB
    For this, the default need to be changed as follows:
    Heap: 4GB -> 1GB
    Direct: 8GB -> 3GB
    CodeCache: 1GB -> 512MB
    MaxPermSize: 512MB -> 512MB (Ignored if JDK8+)

----


> Reduce the default memory from a total of 13GB to 5GB
> -----------------------------------------------------
>
>                 Key: DRILL-6076
>                 URL: https://issues.apache.org/jira/browse/DRILL-6076
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Kunal Khatua
>            Assignee: Kunal Khatua
>            Priority: Critical
>             Fix For: 1.13.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Currently, the default memory requirements for Drill are about 13GB, with the following
allocations:
> * 4GB Heap
> * 8GB Direct Memory
> * 1GB CodeCache
> * 512MB MaxPermSize
> Also, with Drill 1.12.0, the recommendation is to move to JDK8, which makes the MaxPermSize
as irrelevant.
> With that, the default requirements total to 13GB, which is rather high. This is especially
a problem for scenarios where people are trying out Drill and might be using this in a development
environment where 13GB is too high.
> When using the public [test framework|https://github.com/mapr/drill-test-framework/]
for Apache Drill, it was observed that the framework's functional and unit tests passed successfully
with memory as little as 5GB; based on the following allocation:
> * 1GB Heap
> * 3GB Direct Memory
> * 512MB CodeCache
> * 512MB MaxPermSize
> Based on this finding, the proposal is to reduce the defaults from the current settings
to the values just mentioned above. The drill-env.sh file already has details in the comments,
along with the recommended values that reflect the original 13GB defaults.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message