drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-2100) Drill not deleting spooling files
Date Thu, 21 Apr 2016 12:18:25 GMT

    [ https://issues.apache.org/jira/browse/DRILL-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251785#comment-15251785
] 

ASF GitHub Bot commented on DRILL-2100:
---------------------------------------

Github user vdiravka commented on a diff in the pull request:

    https://github.com/apache/drill/pull/454#discussion_r60569863
  
    --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/xsort/ExternalSortBatch.java
---
    @@ -116,6 +119,7 @@
       private boolean first = true;
       private int targetRecordCount;
       private final String fileName;
    +  private Set<Path> currSpillDirs = new TreeSet();
    --- End diff --
    
    Done.


> Drill not deleting spooling files
> ---------------------------------
>
>                 Key: DRILL-2100
>                 URL: https://issues.apache.org/jira/browse/DRILL-2100
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Relational Operators
>    Affects Versions: 0.8.0
>            Reporter: Abhishek Girish
>            Assignee: Deneche A. Hakim
>             Fix For: 1.7.0
>
>
> Currently, after forcing queries to use an external sort by switching off hash join/agg
causes spill-to-disk files accumulating. 
> This causes issues with disk space availability when the spill is configured to be on
the local file system (/tmp/drill). Also not optimal when configured to use DFS (custom).

> Drill must clean up all temporary files created after a query completes or after a drillbit
restart. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message