drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Challapalli (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5146) Unnecessary spilling to disk by sort when we only have 5000 rows with one column
Date Wed, 21 Dec 2016 19:15:58 GMT
Rahul Challapalli created DRILL-5146:
----------------------------------------

             Summary: Unnecessary spilling to disk by sort when we only have 5000 rows with
one column
                 Key: DRILL-5146
                 URL: https://issues.apache.org/jira/browse/DRILL-5146
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Relational Operators
            Reporter: Rahul Challapalli


git.commit.id.abbrev=cf2b7c7

The below query spills to disk for the sort. The dataset contains 5000 files and each file
contains a single record. 
{code}
select * from dfs.`/drill/testdata/resource-manager/5000files/text` order by columns[1];
{code}

Enviironment :
{code}
DRILL_MAX_DIRECT_MEMORY="16G"
DRILL_MAX_HEAP="4G"
{code}

I attached the dataset, logs and the profile



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message