drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hao Zhu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-1645) Can not query any column if the row size is larger than 128K
Date Thu, 06 Nov 2014 17:27:33 GMT
Hao Zhu created DRILL-1645:
------------------------------

             Summary: Can not query any column if the row size is larger than 128K
                 Key: DRILL-1645
                 URL: https://issues.apache.org/jira/browse/DRILL-1645
             Project: Apache Drill
          Issue Type: Bug
          Components: Query Planning & Optimization
    Affects Versions: 0.6.0
            Reporter: Hao Zhu
         Attachments: wrapper.json

If the row size is larger than 128K, drill can not query any column no matter how small the
column is.
So once the top level row of the json file is larger than 128K, then we can not query anything
from this file.

We need drill can query small columns which is below the limitation at least.

Reproduce:
{code}
0: jdbc:drill:> select * from `wrapper.json`;
Query failed: Failure while running fragment. Record is too long. Max allowed record size
is 131072 bytes. [7894614e-9928-4aa5-b649-2d085d01a55b]

Error: exception while executing query: Failure while trying to get next result batch. (state=,code=0)
0: jdbc:drill:> select id from `wrapper.json`;
Query failed: Failure while running fragment. Record is too long. Max allowed record size
is 131072 bytes. [ed61693e-d4da-478e-b85d-1fb7d9621243]

Error: exception while executing query: Failure while trying to get next result batch. (state=,code=0)
{code}

The sample data format is like below(Complete sample data is attached.):
In above test case, the "id" column should be fetched since it is very small.
{code}
[root@maprdemo data]# more wrapper.json 
{"id": 1,"supercolumn": {"content":testtesttesttesttesttestt......."}}
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message