drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-1645) Can not query any column if the row size is larger than 128K
Date Sun, 04 Jan 2015 23:58:07 GMT

    [ https://issues.apache.org/jira/browse/DRILL-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264102#comment-14264102
] 

Jacques Nadeau commented on DRILL-1645:
---------------------------------------

This was constrained to JSON and has now been removed.

> Can not query any column if the row size is larger than 128K
> ------------------------------------------------------------
>
>                 Key: DRILL-1645
>                 URL: https://issues.apache.org/jira/browse/DRILL-1645
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>    Affects Versions: 0.6.0
>            Reporter: Hao Zhu
>             Fix For: 0.7.0
>
>         Attachments: wrapper.json
>
>
> If the row size is larger than 128K, drill can not query any column no matter how small
the column is.
> So once the top level row of the json file is larger than 128K, then we can not query
anything from this file.
> We need drill can query small columns which is below the limitation at least.
> Reproduce:
> {code}
> 0: jdbc:drill:> select * from `wrapper.json`;
> Query failed: Failure while running fragment. Record is too long. Max allowed record
size is 131072 bytes. [7894614e-9928-4aa5-b649-2d085d01a55b]
> Error: exception while executing query: Failure while trying to get next result batch.
(state=,code=0)
> 0: jdbc:drill:> select id from `wrapper.json`;
> Query failed: Failure while running fragment. Record is too long. Max allowed record
size is 131072 bytes. [ed61693e-d4da-478e-b85d-1fb7d9621243]
> Error: exception while executing query: Failure while trying to get next result batch.
(state=,code=0)
> {code}
> The sample data format is like below(Complete sample data is attached.):
> In above test case, the "id" column should be fetched since it is very small.
> {code}
> [root@maprdemo data]# more wrapper.json 
> {"id": 1,"supercolumn": {"content":testtesttesttesttesttestt......."}}
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message