drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Hou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5805) External Sort runs out of memory
Date Tue, 19 Sep 2017 20:42:00 GMT
Robert Hou created DRILL-5805:
---------------------------------

             Summary: External Sort runs out of memory
                 Key: DRILL-5805
                 URL: https://issues.apache.org/jira/browse/DRILL-5805
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Relational Operators
    Affects Versions: 1.11.0
            Reporter: Robert Hou
            Assignee: Paul Rogers
             Fix For: 1.12.0


Query is:
{noformat}
ALTER SESSION SET `exec.sort.disable_managed` = false;
alter session set `planner.width.max_per_node` = 5;
alter session set `planner.disable_exchanges` = true;
alter session set `planner.width.max_per_query` = 100;
select count(*) from (select * from (select id, flatten(str_list) str from dfs.`/drill/testdata/resource-manager/flatten-large-small.json`)
d order by d.str) d1 where d1.id=0;
{noformat}

Plan is:
{noformat}
| 00-00    Screen
00-01      Project(EXPR$0=[$0])
00-02        StreamAgg(group=[{}], EXPR$0=[COUNT()])
00-03          Project($f0=[0])
00-04            SelectionVectorRemover
00-05              Filter(condition=[=($0, 0)])
00-06                SelectionVectorRemover
00-07                  Sort(sort0=[$1], dir0=[ASC])
00-08                    Flatten(flattenField=[$1])
00-09                      Project(id=[$0], str=[$1])
00-10                        Scan(groupscan=[EasyGroupScan [selectionRoot=maprfs:/drill/testdata/resource-manager/flatten-large-small.json,
numFiles=1, columns=[`id`, `str_list`], files=[maprfs:///drill/testdata/resource-manager/flatten-large-small.json]]])
{noformat}

sys.version is:
{noformat}
| 1.12.0-SNAPSHOT  | c4211d3b545b0d1996b096a8e1ace35376a63977  | Fix for DRILL-5670  | 09.09.2017
@ 14:38:25 PDT  | root@qa-node190.qa.lab  | 11.09.2017 @ 14:27:16 PDT  |
{noformat}

mult drill5447_1



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message