drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Parth Chandra (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-2259) Projecting a nested repeated map results in IOOBE when the data has schema changes
Date Wed, 18 Feb 2015 22:27:12 GMT

     [ https://issues.apache.org/jira/browse/DRILL-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Parth Chandra updated DRILL-2259:
---------------------------------
    Fix Version/s: 0.9.0

> Projecting a nested repeated map results in IOOBE when the data has schema changes
> ----------------------------------------------------------------------------------
>
>                 Key: DRILL-2259
>                 URL: https://issues.apache.org/jira/browse/DRILL-2259
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Data Types
>            Reporter: Rahul Challapalli
>            Assignee: Daniel Barclay (Drill/MapR)
>             Fix For: 0.9.0
>
>         Attachments: error.log, file1.json, file2.json, file3.json
>
>
> git.commit.id.abbrev=6676f2d
> The data set contains 3 files with schema changes among them. By schema changes I refer
to adding/removing fields among records/files
> The below query which does a simple project on a field which does not have a schema change
and is present in all the records
> {code}
> select d.type type, d.map.rm[1].rptd  from `schema_changes` d;
> +------------+------------+
> |    type    |   EXPR$1   |
> +------------+------------+
> | web        | [{"a":"bar"},{"c":1},{"d":4.5}] |
> | store      | [{"a":"bar"},{"c":-1},{"d":4.5}] |
> Query failed: RemoteRpcException: Failure while running fragment., index: -4, length:
4 (expected: range(0, 16384)) [ 289ca604-0ece-45ff-94ec-35c11264d7a8 on qa-node190.qa.lab:31010
]
> [ 289ca604-0ece-45ff-94ec-35c11264d7a8 on qa-node190.qa.lab:31010 ]
> java.lang.RuntimeException: java.sql.SQLException: Failure while executing query.
> 	at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
> 	at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
> 	at sqlline.SqlLine.print(SqlLine.java:1809)
> 	at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
> 	at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
> 	at sqlline.SqlLine.dispatch(SqlLine.java:889)
> 	at sqlline.SqlLine.begin(SqlLine.java:763)
> 	at sqlline.SqlLine.start(SqlLine.java:498)
> 	at sqlline.SqlLine.main(SqlLine.java:460)
> {code}
> The below query succeeds when we explicitly read from any one file
> {code}
> select d.type type, d.map.rm[1].rptd  from `schema_changes/file3.json` d;
> +------------+------------+
> |    type    |   EXPR$1   |
> +------------+------------+
> | web        | [{"a":"bar"},{"c":1},{"d":4.5}] |
> | store      | [{"a":"bar"},{"c":-1},{"d":4.5}] |
> +------------+------------+
> 2 rows selected (0.064 seconds)
> {code}
> I attached the data set and the error from the logs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message