drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aman Sinha (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-2012) Flatten fails when we filter by a non-projected column
Date Tue, 24 Feb 2015 23:42:04 GMT

     [ https://issues.apache.org/jira/browse/DRILL-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aman Sinha updated DRILL-2012:
------------------------------
    Fix Version/s: 0.9.0

> Flatten  fails when we filter by a non-projected column
> -------------------------------------------------------
>
>                 Key: DRILL-2012
>                 URL: https://issues.apache.org/jira/browse/DRILL-2012
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>            Reporter: Rahul Challapalli
>            Assignee: Jason Altekruse
>            Priority: Critical
>             Fix For: 0.9.0
>
>         Attachments: DRILL-2012.1.patch, DRILL-2012.2.patch, Plan.txt, error.log
>
>
> git.commit.id.abbrev=b491cdb
> {code}
> {
>     "id": "0001",
>     "type": "donut",
>     "name": "Cake",
>     "ppu": 0.55,
>     "batters":
>         {
>             "batter":
>                 [
>                     { "id": "1001", "type": "Regular" },
>                     { "id": "1002", "type": "Chocolate" },
>                     { "id": "1003", "type": "Blueberry" },
>                     { "id": "1004", "type": "Devil's Food" }
>                 ]
>         },
>     "topping":
>         [
>             { "id": "5001", "type": "None" },
>             { "id": "5002", "type": "Glazed" },
>             { "id": "5005", "type": "Sugar" },
>             { "id": "5007", "type": "Powdered Sugar" },
>             { "id": "5006", "type": "Chocolate with Sprinkles" },
>             { "id": "5003", "type": "Chocolate" },
>             { "id": "5004", "type": "Maple" }
>         ]
> }
> {code}
> The below query fails :
> {code}
> select j.id id, j.name name, flatten(j.topping) tt, flatten(j.batters.batter) bb from
`sample.json` j where j.type = 'donut';
> Query failed: Query failed: Failure while running fragment., Trying to flatten a non-repeated
filed. [ 98ff5db0-4aa7-4f65-9a7a-93ae8bc41f6b on qa-node190.qa.lab:31010 ]
> [ 98ff5db0-4aa7-4f65-9a7a-93ae8bc41f6b on qa-node190.qa.lab:31010 ]
> {code}
> However if I include the filter column in the list of selected columns, then the query
succeeds.
> {code}
> select j.type, j.id id, j.name name, flatten(j.topping) tt, flatten(j.batters.batter)
bb from `user.json` j where j.type = 'donut';
> +------------+------------+------------+------------+------------+
> |    type    |     id     |    name    |     tt     |     bb     |
> +------------+------------+------------+------------+------------+
> | donut      | 0001       | Cake       | {"id":"5001","type":"None"} | {"id":"1001","type":"Regular"}
|
> | donut      | 0001       | Cake       | {"id":"5001","type":"None"} | {"id":"1002","type":"Chocolate"}
|
> | donut      | 0001       | Cake       | {"id":"5001","type":"None"} | {"id":"1003","type":"Blueberry"}
|
> | donut      | 0001       | Cake       | {"id":"5001","type":"None"} | {"id":"1004","type":"Devil's
Food"} |
> | donut      | 0001       | Cake       | {"id":"5002","type":"Glazed"} | {"id":"1001","type":"Regular"}
|
> | donut      | 0001       | Cake       | {"id":"5002","type":"Glazed"} | {"id":"1002","type":"Chocolate"}
|
> | donut      | 0001       | Cake       | {"id":"5002","type":"Glazed"} | {"id":"1003","type":"Blueberry"}
|
> | donut      | 0001       | Cake       | {"id":"5002","type":"Glazed"} | {"id":"1004","type":"Devil's
Food"} |
> | donut      | 0001       | Cake       | {"id":"5005","type":"Sugar"} | {"id":"1001","type":"Regular"}
|
> | donut      | 0001       | Cake       | {"id":"5005","type":"Sugar"} | {"id":"1002","type":"Chocolate"}
|
> | donut      | 0001       | Cake       | {"id":"5005","type":"Sugar"} | {"id":"1003","type":"Blueberry"}
|
> | donut      | 0001       | Cake       | {"id":"5005","type":"Sugar"} | {"id":"1004","type":"Devil's
Food"} |
> | donut      | 0001       | Cake       | {"id":"5007","type":"Powdered Sugar"} | {"id":"1001","type":"Regular"}
|
> | donut      | 0001       | Cake       | {"id":"5007","type":"Powdered Sugar"} | {"id":"1002","type":"Chocolate"}
|
> | donut      | 0001       | Cake       | {"id":"5007","type":"Powdered Sugar"} | {"id":"1003","type":"Blueberry"}
|
> | donut      | 0001       | Cake       | {"id":"5007","type":"Powdered Sugar"} | {"id":"1004","type":"Devil's
Food"} |
> | donut      | 0001       | Cake       | {"id":"5006","type":"Chocolate with Sprinkles"}
| {"id":"1001","type":"Regular"} |
> | donut      | 0001       | Cake       | {"id":"5006","type":"Chocolate with Sprinkles"}
| {"id":"1002","type":"Chocolate"} |
> | donut      | 0001       | Cake       | {"id":"5006","type":"Chocolate with Sprinkles"}
| {"id":"1003","type":"Blueberry"} |
> | donut      | 0001       | Cake       | {"id":"5006","type":"Chocolate with Sprinkles"}
| {"id":"1004","type":"Devil's Food"} |
> | donut      | 0001       | Cake       | {"id":"5003","type":"Chocolate"} | {"id":"1001","type":"Regular"}
|
> | donut      | 0001       | Cake       | {"id":"5003","type":"Chocolate"} | {"id":"1002","type":"Chocolate"}
|
> | donut      | 0001       | Cake       | {"id":"5003","type":"Chocolate"} | {"id":"1003","type":"Blueberry"}
|
> | donut      | 0001       | Cake       | {"id":"5003","type":"Chocolate"} | {"id":"1004","type":"Devil's
Food"} |
> | donut      | 0001       | Cake       | {"id":"5004","type":"Maple"} | {"id":"1001","type":"Regular"}
|
> | donut      | 0001       | Cake       | {"id":"5004","type":"Maple"} | {"id":"1002","type":"Chocolate"}
|
> | donut      | 0001       | Cake       | {"id":"5004","type":"Maple"} | {"id":"1003","type":"Blueberry"}
|
> | donut      | 0001       | Cake       | {"id":"5004","type":"Maple"} | {"id":"1004","type":"Devil's
Food"} |
> {code}
> I attached the relevant log file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message