drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Challapalli (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5474) Spill directory is not being cleaned up immediately after cancellation
Date Thu, 04 May 2017 21:21:04 GMT
Rahul Challapalli created DRILL-5474:

             Summary: Spill directory is not being cleaned up immediately after cancellation
                 Key: DRILL-5474
                 URL: https://issues.apache.org/jira/browse/DRILL-5474
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Relational Operators
    Affects Versions: 1.10.0
            Reporter: Rahul Challapalli
            Assignee: Paul Rogers

I allowed the below query to run until it stats spilling. Now I cancelled the query and the
sqlline prompt returned immediately. From this point, it took ~50 seconds for this spill directory
to be deleted and during this time, the spill file constantly grew in size
ALTER SESSION SET `exec.sort.disable_managed` = false;
alter session set `planner.width.max_per_node` = 1;
alter session set `planner.disable_exchanges` = true;
alter session set `planner.width.max_per_query` = 1;
alter session set `planner.memory.max_query_memory_per_node` = 1052428800;
alter session set `planner.enable_decimal_data_type` = true;
select count(*) from (
  select * from dfs.`/drill/testdata/resource-manager/all_types_large` d1
  order by d1.map.missing, d1.missing12.x, d1.missing1, d1.missing2, d1.missing3, d1.missing4,
    d1.missing5, d1.missing6, d1.missing7, d1.missing8, d1.missing9, d1.missing10, d1.missing11,
    d1.missing12.x, d1.missing13, d1.missing14, d1.missing15, d1.missing16, d1.missing17,
    d1.missing19, d1.missing20, d1.missing21, d1.missing22, d1.missing23, d1.missing24, d1.missing25,
    d1.missing26, d1.missing27, d1.missing28, d1.`missing 29`, d1.missing30, d1.missing31,
    d1.missing33, d1.missing34, d1.m1
) d where d.missing3 is false;

This message was sent by Atlassian JIRA

View raw message