drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Rogers (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (DRILL-5154) OOM error in external sort on top of 400GB data set generated using terasort benchamark
Date Wed, 28 Jun 2017 23:18:03 GMT

     [ https://issues.apache.org/jira/browse/DRILL-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Paul Rogers reassigned DRILL-5154:
----------------------------------

    Assignee: Paul Rogers

> OOM error in external sort on top of 400GB data set generated using terasort benchamark
> ---------------------------------------------------------------------------------------
>
>                 Key: DRILL-5154
>                 URL: https://issues.apache.org/jira/browse/DRILL-5154
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Relational Operators
>    Affects Versions: 1.10.0
>            Reporter: Rahul Challapalli
>            Assignee: Paul Rogers
>         Attachments: 27a3de95-e30b-8890-6653-80fd6c49a3a1.sys.drill
>
>
> git.commit.id.abbrev=cf2b7c7
> The below query fails with an OOM in external sort
> {code}
> No of drillbits : 1
> Nodes in Mapr cluster : 2
> DRILL_MAX_DIRECT_MEMORY="16G"
> DRILL_MAX_HEAP="4G"
> select * from (select * from dfs.`/drill/testdata/resource-manager/terasort-data/part-m-00000.tbl`
order by columns[0]) d where d.columns[0] = 'null';
> Error: RESOURCE ERROR: One or more nodes ran out of memory while executing the query.
> Unable to allocate buffer of size 8388608 due to memory limit. Current allocation: 8441872
> Fragment 1:6
> [Error Id: 87ede736-b480-4286-b472-7694fdd2f7da on qa-node183.qa.lab:31010] (state=,code=0)
> {code}
> I attached the logs and the query profile



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message