drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Volodymyr Vysotskyi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5396) A flatten query on top of 2 files with one record each causes oversize allocation error randomly
Date Fri, 19 May 2017 09:55:04 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017157#comment-16017157
] 

Volodymyr Vysotskyi commented on DRILL-5396:
--------------------------------------------

This issue is reproduced for the case when Drill first reads a file with an empty array. It
will be fixed in the fix for the DRILL-4824.

> A flatten query on top of 2 files with one record each causes oversize allocation error
randomly
> ------------------------------------------------------------------------------------------------
>
>                 Key: DRILL-5396
>                 URL: https://issues.apache.org/jira/browse/DRILL-5396
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Data Types, Storage - JSON
>    Affects Versions: 1.10.0, 1.11.0
>            Reporter: Rahul Challapalli
>
> git.commit.id.abbrev=38ef562
> As part of verifying DRILL-3562, I came up with the below 2 files
> File 1:
> {code}
> { "a": { "b": { "c": [] } } }
> {code}
> File 2:
> {code}
> { "a": { "b": { "c": [1] } } }
> {code}
> Now the below query work on individual files, however when I run the query on a directory
containing both the files, I randomly hit the below error
> {code}
> select FLATTEN(t.a.b.c) AS c from dfs.`/drill/testdata/json_kvgenflatten/drill3562` t;
> Error: SYSTEM ERROR: OversizedAllocationException: Unable to expand the buffer. Max allowed
buffer size is reached.
> Fragment 0:0
> [Error Id: e556243b-7ad6-4131-81f7-e8b225c9c8bc on qa-node182.qa.lab:31010] (state=,code=0)
> {code}
> This could be related to the fix for DRILL-3562



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message