drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hanifi Gunes (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (DRILL-1536) Selecting a null valued field fails on json input format with an irrelevant error message
Date Tue, 28 Oct 2014 23:16:34 GMT

     [ https://issues.apache.org/jira/browse/DRILL-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Hanifi Gunes resolved DRILL-1536.
    Resolution: Fixed

A superset of the problem described in this ticket is fixed by DRILL-1547. Marking as resolved.

> Selecting a null valued field fails on json input format with an irrelevant error message
> -----------------------------------------------------------------------------------------
>                 Key: DRILL-1536
>                 URL: https://issues.apache.org/jira/browse/DRILL-1536
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Hanifi Gunes
>            Assignee: Jason Altekruse
> Running 
> {code:sql}
> select t.id from dfs.`data/simple.json` t;
> {code}
> against
> {panel:title=simple.json}
> \{"id":null\}
> {panel}
> throws
> {panel}
> org.apache.drill.common.exceptions.DrillRuntimeException: Record is too big to fit into
allocated ValueVector
> 	at org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:121)
> 	at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:158)
> 	at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:117)
> 	at org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:128)
> 	at java.lang.Thread.run(Thread.java:745)
> {panel}
> We need to make sure a value vector for the field `id` is allocated before attempting
to manipulate the vector. Currently JsonReader does nothing beyond a bound check when encountered
with a null value. We should implement proper null value handling.
> Also the above error message should precisely reflect the root cause of the problem.
Thrown exception in this case is irrelevant and misleading.

This message was sent by Atlassian JIRA

View raw message