carbondata-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ravipes...@apache.org
Subject [36/50] [abbrv] incubator-carbondata git commit: Problem: Dataloads fail when no. of column in load query is greater than the no. of column in create table
Date Fri, 20 Jan 2017 17:39:44 GMT
Problem: Dataloads  fail when no. of column in load query is greater than the no. of column
in create table

Analysis: During data load mapping of columns order is maintained between schema and columns
provided in Fileheader/CSV file. If any duplicate column is provided in the fileheader, the
length of array exceeds for the mapping order array as extra columns are getting matched and
hence array index of bound exception is thrown.

Fix: Add a check for looping only till the mapping order array length is less than the number
of schema columns.

Impact Area: Data load flow


Project: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/commit/1cd0450b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/tree/1cd0450b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/diff/1cd0450b

Branch: refs/heads/branch-1.0
Commit: 1cd0450b419d8a578c629d6bd6aba248f453ef22
Parents: 28abe7e
Author: manishgupta88 <tomanishgupta18@gmail.com>
Authored: Fri Jan 20 16:43:25 2017 +0530
Committer: ravipesala <ravi.pesala@gmail.com>
Committed: Fri Jan 20 18:18:09 2017 +0530

----------------------------------------------------------------------
 .../src/test/resources/seq_500Records.csv       | 500 +++++++++++++++++++
 .../TestDataLoadWithColumnsMoreThanSchema.scala |  12 +
 .../newflow/parser/impl/RowParserImpl.java      |   3 +-
 3 files changed, 514 insertions(+), 1 deletion(-)
----------------------------------------------------------------------



Mime
View raw message