drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vitalii Diravka (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-2100) Drill not deleting spooling files
Date Mon, 28 Mar 2016 16:38:25 GMT

    [ https://issues.apache.org/jira/browse/DRILL-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214433#comment-15214433
] 

Vitalii Diravka commented on DRILL-2100:
----------------------------------------

[~haozhu], 

Added deleting of the whole directory for SQL profile Id ("/tmp/drill/spill/2aa9600f-016a-5283-f98e-ef22942981c2"
for example) when FileSystem is closed. 
https://github.com/vdiravka/drill/commit/a5f891dbba06c2f15c8478c7843394c809de25c0

> Drill not deleting spooling files
> ---------------------------------
>
>                 Key: DRILL-2100
>                 URL: https://issues.apache.org/jira/browse/DRILL-2100
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Relational Operators
>    Affects Versions: 0.8.0
>            Reporter: Abhishek Girish
>             Fix For: Future
>
>
> Currently, after forcing queries to use an external sort by switching off hash join/agg
causes spill-to-disk files accumulating. 
> This causes issues with disk space availability when the spill is configured to be on
the local file system (/tmp/drill). Also not optimal when configured to use DFS (custom).

> Drill must clean up all temporary files created after a query completes or after a drillbit
restart. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message