drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Barclay (Drill) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-2924) IOBException when querying a table which has 1 file and a subfolder with 1 file
Date Thu, 30 Apr 2015 20:01:06 GMT

    [ https://issues.apache.org/jira/browse/DRILL-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522148#comment-14522148
] 

Daniel Barclay (Drill) commented on DRILL-2924:
-----------------------------------------------

Investigation notes:
- Most of the content of {{toplevel_file.json}} (corresponding to {{a.json}} in description)
and {{b.json}} is not relevant:  Stripping {{toplevel_file.json}} down to just "{{{\}}]" and
{{b.json}} down to just "{{{"x":\[{}]\}}}" didn't change the error result.
- The nesting of {{b.json}} in {{folder1}} is not relevant.  (Moving {{b.json}} up one level
(with above change) didn't change the error result.)
- *File names are significant*:  
  -- Renaming "{{toplevel_file.json}}" to "{{a.json}}" (with above changes) resulted in one
column, named "{{*}}" (is that right?), with two rows, both {{null}} (that's wrong, right?).
  -- Renaming the "{{a.json}}" to "{{c.json}}" (lexicographically after "{{b.json}}") yielded
the error again.



> IOBException when querying a table which has 1 file and a subfolder with 1 file
> -------------------------------------------------------------------------------
>
>                 Key: DRILL-2924
>                 URL: https://issues.apache.org/jira/browse/DRILL-2924
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Client - JDBC, Storage - JSON, Storage - Parquet
>            Reporter: Rahul Challapalli
>            Assignee: Daniel Barclay (Drill)
>            Priority: Critical
>             Fix For: 1.0.0
>
>         Attachments: data1.tar, error.log
>
>
> git.commit.id.abbrev=5fbd274
> Below is the folder structure
> Data Structure :
> {code}
> data1
>   -- a.json
>   -- folder1
>        -- b.json
> {code}
> Query :
> {code}
> 0: jdbc:drill:schema=dfs_eea> select * from `data1`;
> +------------+---------------+-----------------+
> |    dir0    | executionTime | stationBeanList |
> +------------+---------------+-----------------+
> | folder1    | 2014-11-04 11:54:01 AM | [{"id":72,"stationName":"W 52 St & 11 Ave",
..........
> java.lang.IndexOutOfBoundsException: index: -4, length: 4 (expected: range(0, 4))
> 	at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:200)
> 	at io.netty.buffer.DrillBuf.chk(DrillBuf.java:222)
> 	at io.netty.buffer.DrillBuf.getInt(DrillBuf.java:500)
> 	at org.apache.drill.exec.vector.UInt4Vector$Accessor.get(UInt4Vector.java:299)
> 	at org.apache.drill.exec.vector.complex.RepeatedMapVector$RepeatedMapAccessor.getValueCount(RepeatedMapVector.java:470)
> 	at org.apache.drill.exec.vector.accessor.BoundCheckingAccessor.getObject(BoundCheckingAccessor.java:142)
> 	at org.apache.drill.jdbc.impl.TypeConvertingSqlAccessor.getObject(TypeConvertingSqlAccessor.java:790)
> 	at org.apache.drill.jdbc.AvaticaDrillSqlAccessor.getObject(AvaticaDrillSqlAccessor.java:165)
> 	at net.hydromatic.avatica.AvaticaResultSet.getObject(AvaticaResultSet.java:351)
> 	at sqlline.SqlLine$Rows$Row.<init>(SqlLine.java:2388)
> 	at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2504)
> 	at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
> 	at sqlline.SqlLine.print(SqlLine.java:1809)
> 	at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
> 	at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
> 	at sqlline.SqlLine.dispatch(SqlLine.java:889)
> 	at sqlline.SqlLine.begin(SqlLine.java:763)
> 	at sqlline.SqlLine.start(SqlLine.java:498)
> 	at sqlline.SqlLine.main(SqlLine.java:460)
> {code}
> I attached the error log and the data file. Let me know if you need anything



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message