drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kunal Khatua (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4578) "children" missing from results of full scan over JSON data
Date Tue, 21 Mar 2017 00:58:41 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15933912#comment-15933912
] 

Kunal Khatua commented on DRILL-4578:
-------------------------------------

[~khfaraaz] Please verify and close this with tests added to the framework.

> "children" missing from results of full scan over JSON data
> -----------------------------------------------------------
>
>                 Key: DRILL-4578
>                 URL: https://issues.apache.org/jira/browse/DRILL-4578
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - JSON
>         Environment: 4 node cluster CentOS
>            Reporter: Khurram Faraaz
>            Assignee: Serhii Harnyk
>            Priority: Critical
>             Fix For: 1.10.0
>
>
> One of the fields named "children" is missing from the output of SELECT * over the JSON
data, with or without enabling all_text_mode for JSON data.
> Projecting just the "children" field returns a null.
> Note that children field holds an empty array.
>  Drill 1.7.0-SNAPSHOT  commit ID e7e9b73c
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> alter session set `store.json.all_text_mode`=true;
> +-------+------------------------------------+
> |  ok   |              summary               |
> +-------+------------------------------------+
> | true  | store.json.all_text_mode updated.  |
> +-------+------------------------------------+
> 1 row selected (0.118 seconds)
> 0: jdbc:drill:schema=dfs.tmp> select * from `employee.json`;
> +------------+-----------+----------+------+------------+---------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------+---------------------------------------------------------------+
> | firstName  | lastName  | isAlive  | age  | height_cm  |                           
               address                                           |                       
             phoneNumbers                                     |                          
 hobbies                            |
> +------------+-----------+----------+------+------------+---------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------+---------------------------------------------------------------+
> | John       | Smith     | true     | 45   | 177.6      | {"streetAddress":"29 4th Street","city":"New
York","state":"NY","postalCode":"10021-3100"}  | [{"type":"home","number":"212 555-1234"},{"type":"office","number":"646
555-4567"}]  | ["scuba diving","hiking","biking","rock climbing","surfing"]  |
> +------------+-----------+----------+------+------------+---------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------+---------------------------------------------------------------+
> 1 row selected (0.214 seconds)
> 0: jdbc:drill:schema=dfs.tmp> select t.children from `employee.json` t;
> +-----------+
> | children  |
> +-----------+
> | null      |
> +-----------+
> 1 row selected (0.148 seconds)
> {noformat}
> JSON data used in test
> {noformat}
> [root@centos-01 ~]# cat employee.json
> {
>   "firstName": "John",
>   "lastName": "Smith",
>   "isAlive": true,
>   "age": 45,
>   "height_cm": 177.6,
>   "address": {
>     "streetAddress": "29 4th Street",
>     "city": "New York",
>     "state": "NY",
>     "postalCode": "10021-3100"
>   },
>   "phoneNumbers": [
>     {
>       "type": "home",
>       "number": "212 555-1234"
>     },
>     {
>       "type": "office",
>       "number": "646 555-4567"
>     }
>   ],
>   "children": [],
>   "hobbies": ["scuba diving","hiking","biking","rock climbing","surfing"]
> }
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message