drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abhishek Girish (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-2221) CTAS on JSON file with empty arrays creates unreadable files (JSON)
Date Thu, 12 Feb 2015 02:17:12 GMT
Abhishek Girish created DRILL-2221:
--------------------------------------

             Summary: CTAS on JSON file with empty arrays creates unreadable files (JSON)
                 Key: DRILL-2221
                 URL: https://issues.apache.org/jira/browse/DRILL-2221
             Project: Apache Drill
          Issue Type: Bug
          Components: Storage - JSON
            Reporter: Abhishek Girish
            Assignee: Steven Phillips
         Attachments: drillbit_empty_array.log

Source JSON file:

{
  "a": "A1",
  "b": [ "B1", "B2" ],
  "c": [ "C1", "C2" ]
}
{
  "a": "A2",
  "b": [ "B3" ],
  *"c": []*
}

> select * from `file.json` ;
+------------+------------+------------+
|     a      |     b      |     c      |
+------------+------------+------------+
| A1         | ["B1","B2"] | ["C1","C2"] |
| A2         | ["B3"]     | []         |
+------------+------------+------------+
2 rows selected (0.039 seconds)

>alter session set `store.format` = 'json';

> create table file_json as select * from `file.json` ;
[Success]

Created file contents:

{
  "a" : "A1",
  "b" : [ "B1", "B2" ],
  "c" : [ "C1", "C2" ]
} {
  "a" : "A2",
  "b" : [ "B3" ],
 * "c"*
}

This file cannot be read by Drill:

> select * from file_json ;
Query failed: Query stopped., Unexpected character ('}' (code 125)): was expecting a colon
to separate field name and value
 at [Source: org.apache.drill.exec.vector.complex.fn.JsonReader@67b4040a; line: 8, column:
2] [ 64bb2b5d-5d83-4ae3-a7dc-7a7e44b28bf5 on abhi8.qa.lab:31010 ]
Error: exception while executing query: Failure while executing query. (state=,code=0)

Log attached. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message