drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Phillips (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-2730) Use different paths for ExternalSort spill files
Date Thu, 09 Apr 2015 01:27:12 GMT
Steven Phillips created DRILL-2730:
--------------------------------------

             Summary: Use different paths for ExternalSort spill files
                 Key: DRILL-2730
                 URL: https://issues.apache.org/jira/browse/DRILL-2730
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Relational Operators
            Reporter: Steven Phillips
            Assignee: Steven Phillips


Currently, all of the spill files for a drillbit end up in the same directory (or directories
if multiple are configured). There is no separation based on query or fragment. This makes
it very difficult to explore the spill files via the filesystem.

We should create a directory structure that will organize the files more effectively, create
a directory tree with query id, major fragment id, minor fragment id, and operator id.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message