drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victoria Markman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-2408) Invalid (0 length) parquet file created by CTAS
Date Mon, 06 Apr 2015 16:06:12 GMT

    [ https://issues.apache.org/jira/browse/DRILL-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14481352#comment-14481352
] 

Victoria Markman commented on DRILL-2408:
-----------------------------------------

Still does not work for me with the latest build:

{code}
#Fri Apr 03 23:03:15 EDT 2015
git.commit.id.abbrev=4f21357
{code}

{code}
0: jdbc:drill:schema=dfs> select c_integer, c_bigint, c_date, c_time, c_varchar from j4
where c_bigint is null;
+------------+------------+------------+------------+------------+
| c_integer  |  c_bigint  |   c_date   |   c_time   | c_varchar  |
+------------+------------+------------+------------+------------+
+------------+------------+------------+------------+------------+
No rows selected (0.126 seconds)
0: jdbc:drill:schema=dfs> create table ctas_t6(c1,c2,c3,c4,c5) as select c_integer, c_bigint,
c_date, c_time, c_varchar from j4 where c_bigint is null;
+------------+---------------------------+
|  Fragment  | Number of records written |
+------------+---------------------------+
| 0_0        | 0                         |
+------------+---------------------------+
1 row selected (0.214 seconds)
0: jdbc:drill:schema=dfs> select * from ctas_t6;
Query failed: IndexOutOfBoundsException: Index: 0, Size: 0

Error: exception while executing query: Failure while executing query. (state=,code=0)
{code}

parquet file was not created, but directory was:
{code}
[Mon Apr 06 09:03:41 root@/mapr/vmarkman.cluster.com/drill/testdata/joins/ctas_t6 ] # pwd
/mapr/vmarkman.cluster.com/drill/testdata/joins/ctas_t6
[Mon Apr 06 09:03:45 root@/mapr/vmarkman.cluster.com/drill/testdata/joins/ctas_t6 ] # ls -l
total 0
{code}

> Invalid (0 length) parquet file created by CTAS
> -----------------------------------------------
>
>                 Key: DRILL-2408
>                 URL: https://issues.apache.org/jira/browse/DRILL-2408
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Writer
>    Affects Versions: 0.8.0
>            Reporter: Aman Sinha
>            Assignee: Deneche A. Hakim
>            Priority: Critical
>             Fix For: 0.9.0
>
>         Attachments: DRILL-2408.1.patch.txt, DRILL-2408.2.patch.txt, DRILL-2408.3.patch.txt
>
>
> We should not be creating 0 length parquet files; subsequent queries on these will fail
with the error shown below. 
> {code}
> 0: jdbc:drill:zk=local> create table tt5 as select * from cp.`tpch/region.parquet`
where 1=0;
> +------------+---------------------------+
> |  Fragment  | Number of records written |
> +------------+---------------------------+
> | 0_0        | 0                         |
> +------------+---------------------------+
> 1 row selected (0.8 seconds)
> 0: jdbc:drill:zk=local> select count(*) from tt5;
> Query failed: RuntimeException: file:/tmp/tt5/0_0_0.parquet is not a Parquet file (too
small)
> Error: exception while executing query: Failure while executing query. 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message