drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vitalii Diravka (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-2100) Drill not deleting spooling files
Date Wed, 04 May 2016 09:35:12 GMT

    [ https://issues.apache.org/jira/browse/DRILL-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15270384#comment-15270384
] 

Vitalii Diravka commented on DRILL-2100:
----------------------------------------

[~jaltekruse] Not certainly in that way. 
Spill directories will delete immediately after success, failed or canceled query due to fs.delete()
in the close() method of ExternalSortBatch.java (also spill directories will be deleted from
deleteOnExit set). It can work without using fs.deleteOnExit(). 
What about fs.deleteOnExit() I use it to delete temporary spill folders for the case when
drillbit process is killed.

> Drill not deleting spooling files
> ---------------------------------
>
>                 Key: DRILL-2100
>                 URL: https://issues.apache.org/jira/browse/DRILL-2100
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Relational Operators
>    Affects Versions: 0.8.0
>            Reporter: Abhishek Girish
>            Assignee: Deneche A. Hakim
>             Fix For: 1.7.0
>
>
> Currently, after forcing queries to use an external sort by switching off hash join/agg
causes spill-to-disk files accumulating. 
> This causes issues with disk space availability when the spill is configured to be on
the local file system (/tmp/drill). Also not optimal when configured to use DFS (custom).

> Drill must clean up all temporary files created after a query completes or after a drillbit
restart. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message