drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Khurram Faraaz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-3365) Query with window function on large dataset fails with "IOException: Mkdirs failed to create spill directory"
Date Mon, 17 Oct 2016 17:52:59 GMT

    [ https://issues.apache.org/jira/browse/DRILL-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582914#comment-15582914
] 

Khurram Faraaz commented on DRILL-3365:
---------------------------------------

I too have hit this on Drill 1.8.0, removing /tmp/drill and then restarting all Drillbits
seems to resolve the problem.

> Query with window function on large dataset fails with "IOException: Mkdirs failed to
create spill directory"
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: DRILL-3365
>                 URL: https://issues.apache.org/jira/browse/DRILL-3365
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Flow
>    Affects Versions: 1.1.0
>            Reporter: Abhishek Girish
>            Priority: Minor
>             Fix For: Future
>
>
> Dataset: TPC-DS SF100 Parquet
> Query: 
> {code:sql}
> SELECT sum(ss.ss_net_paid_inc_tax) OVER (PARTITION BY ss.ss_store_sk ORDER BY ss.ss_customer_sk)
AS PartialSum FROM store_sales ss GROUP BY ss.ss_net_paid_inc_tax, ss.ss_store_sk, ss.ss_customer_sk
 LIMIT 20;
> java.lang.RuntimeException: java.sql.SQLException: SYSTEM ERROR: java.io.IOException:
Mkdirs failed to create /tmp/drill/spill/2a74ac18-0679-ab99-26c6-af41b9af7f4e/major_fragment_1/minor_fragment_17/operator_4
(exists=false, cwd=file:///opt/mapr/drill/drill-1.1.0/bin)
> Fragment 1:17
> [Error Id: 4905b400-fc0f-4287-beba-d1ca18359986 on abhi5.qa.lab:31010]
> 	at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73)
> 	at sqlline.TableOutputFormat$ResizingRowsProvider.next(TableOutputFormat.java:85)
> 	at sqlline.TableOutputFormat.print(TableOutputFormat.java:116)
> 	at sqlline.SqlLine.print(SqlLine.java:1583)
> 	at sqlline.Commands.execute(Commands.java:852)
> 	at sqlline.Commands.sql(Commands.java:751)
> 	at sqlline.SqlLine.dispatch(SqlLine.java:738)
> 	at sqlline.SqlLine.begin(SqlLine.java:612)
> 	at sqlline.SqlLine.start(SqlLine.java:366)
> 	at sqlline.SqlLine.main(SqlLine.java:259)
> {code}
> Was unable to find corresponding logs. This was consistently seen via JDBC program and
sqlline. 
> After I restarted Drillbits the issue seems to have been resolved. But wanted to report
this anyway. Possible explanation is DRILL-2917 (one or more drillbits were in an inconsistent
state)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message