drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abhishek Girish (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-1944) JsonReader fails to read arrays of size 2000
Date Tue, 24 Mar 2015 22:16:54 GMT

     [ https://issues.apache.org/jira/browse/DRILL-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Abhishek Girish updated DRILL-1944:
-----------------------------------
    Summary: JsonReader fails to read arrays of size 2000  (was: Query fails when JSON record
size is greater than )

> JsonReader fails to read arrays of size 2000
> --------------------------------------------
>
>                 Key: DRILL-1944
>                 URL: https://issues.apache.org/jira/browse/DRILL-1944
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - JSON
>            Reporter: Rahul Challapalli
>            Assignee: Jason Altekruse
>            Priority: Blocker
>         Attachments: error.log, scalar-array-2000.json
>
>
> git.commit.id.abbrev=b491cdb
> I tried a select * on a json file which contained a single array of strings. Drill fails
to read the file if the array has 2000 elements. However it works for an array size of 1500.
So I am not sure if it is a known limitation or a bug.
> Query :
> {code}
> jdbc:drill:schema=dfs.drillTestDir> select * from `data-shapes/wide-records/single/wide-record1.json`;
> Query failed: Query stopped., Record was too large to copy into vector. [ 5b320c2f-fff3-4de5-8095-8043c30510fd
on qa-node191.qa.lab:31010 ]
> {code}
> I attached the data file and the error log. Let me know if you have any questions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message