drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victoria Markman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-2802) Projecting dir[n] by itself results in projecting of all columns
Date Thu, 03 Sep 2015 20:28:46 GMT

    [ https://issues.apache.org/jira/browse/DRILL-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729722#comment-14729722
] 

Victoria Markman commented on DRILL-2802:
-----------------------------------------

Verified fixed in 1.2.0

#Thu Sep 03 00:07:29 UTC 2015
git.commit.id.abbrev=9562391


{code}
0: jdbc:drill:schema=dfs> select dir0 from bigtable limit 1;
+-------+
| dir0  |
+-------+
| 2015  |
+-------+
1 row selected (0.203 seconds)

0: jdbc:drill:schema=dfs> select dir1 from bigtable limit 1;
+-------+
| dir1  |
+-------+
| 01    |
+-------+
1 row selected (0.17 seconds)

0: jdbc:drill:schema=dfs> select dir0, dir1 from bigtable limit 1;
+-------+-------+
| dir0  | dir1  |
+-------+-------+
| 2015  | 01    |
+-------+-------+
1 row selected (0.204 seconds)

0: jdbc:drill:schema=dfs> select dir0, * from bigtable limit 1;
+-------+-----+--------+-------------+--------+-------+
| dir0  | a1  |   b1   |     c1      | dir00  | dir1  |
+-------+-----+--------+-------------+--------+-------+
| 2015  | 1   | aaaaa  | 2015-01-01  | 2015   | 01    |
+-------+-----+--------+-------------+--------+-------+
1 row selected (0.242 seconds)
{code}

Jinfeng added unit test in http://git-wip-us.apache.org/repos/asf/drill/blob/f4bb5353/exec/java-exec/src/test/java/org/apache/drill/TestStarQueries.java
with plan verification, it is sufficient for this bug.

> Projecting dir[n] by itself results in projecting of all columns
> ----------------------------------------------------------------
>
>                 Key: DRILL-2802
>                 URL: https://issues.apache.org/jira/browse/DRILL-2802
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>    Affects Versions: 0.9.0
>            Reporter: Victoria Markman
>            Assignee: Jinfeng Ni
>            Priority: Critical
>             Fix For: 1.2.0
>
>         Attachments: 0002-DRILL-2802-Ensure-project-the-right-columns-in-the-f.patch
>
>
> {code}
> 0: jdbc:drill:schema=dfs> select dir1 from bigtable limit 1;
> +------------+------------+------------+------------+
> |     a1     |     b1     |     c1     |    dir1    |
> +------------+------------+------------+------------+
> | 1          | aaaaa      | 2015-01-01 | 01         |
> +------------+------------+------------+------------+
> 1 row selected (0.189 seconds)
> 0: jdbc:drill:schema=dfs> select dir0 from bigtable limit 1;
> +------------+------------+------------+------------+
> |     a1     |     b1     |     c1     |    dir0    |
> +------------+------------+------------+------------+
> | 1          | aaaaa      | 2015-01-01 | 2015       |
> +------------+------------+------------+------------+
> 1 row selected (0.193 seconds)
> {code}
> In explain plan, I don't see project:
> {code}
> 0: jdbc:drill:schema=dfs> explain plan for select dir0 from bigtable;
> +------------+------------+
> |    text    |    json    |
> +------------+------------+
> | 00-00    Screen
> 00-01      Scan(groupscan=[ParquetGroupScan [entries=[ReadEntryWithPath [path=maprfs:/test/bigtable/2015/01/4_0_0.parquet],
ReadEntryWithPath [path=maprfs:/test/bigtable/2015/01/3_0_0.parquet], ReadEntryWithPath [path=maprfs:/test/bigtable/2015/01/5_0_0.parquet],
ReadEntryWithPath [path=maprfs:/test/bigtable/2015/01/1_0_0.parquet], ReadEntryWithPath [path=maprfs:/test/bigtable/2015/01/2_0_0.parquet],
ReadEntryWithPath [path=maprfs:/test/bigtable/2015/01/0_0_0.parquet], ReadEntryWithPath [path=maprfs:/test/bigtable/2015/02/0_0_0.parquet],
ReadEntryWithPath [path=maprfs:/test/bigtable/2015/03/0_0_0.parquet], ReadEntryWithPath [path=maprfs:/test/bigtable/2015/04/0_0_0.parquet],
ReadEntryWithPath [path=maprfs:/test/bigtable/2016/01/parquet.file], ReadEntryWithPath [path=maprfs:/test/bigtable/2016/parquet.file]],
selectionRoot=/test/bigtable, numFiles=11, columns=[`dir0`]]])
> {code}
> If you project both dir0 and dir1, both columns are projected with the correct result:
> {code}
> 0: jdbc:drill:schema=dfs> select dir0, dir1 from bigtable;
> +------------+------------+
> |    dir0    |    dir1    |
> +------------+------------+
> | 2015       | 01         |
> | 2015       | 01         |
> | 2015       | 01         |
> | 2015       | 01         |
> | 2015       | 01         |
> | 2015       | 01         |
> | 2015       | 01         |
> | 2015       | 01         |
> | 2015       | 01         |
> {code}
> {code}
> [Wed Apr 15 14:09:47 root@/mapr/vmarkman.cluster.com/test/bigtable ] # ls -R
> .:
> 2015  2016
> ./2015:
> 01  02  03  04
> ./2015/01:
> 0_0_0.parquet  1_0_0.parquet  2_0_0.parquet  3_0_0.parquet  4_0_0.parquet  5_0_0.parquet
> ./2015/02:
> 0_0_0.parquet
> ./2015/03:
> 0_0_0.parquet
> ./2015/04:
> 0_0_0.parquet
> ./2016:
> 01  parquet.file
> ./2016/01:
> parquet.file
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message