carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ChenLiang (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CARBONDATA-229) Array Index of bound exception thrown from dictionary look up while writing sort index file
Date Sat, 17 Sep 2016 09:47:20 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ChenLiang resolved CARBONDATA-229.
----------------------------------
    Resolution: Fixed

> Array Index of bound exception thrown from dictionary look up while writing sort index
file
> -------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-229
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-229
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Manish Gupta
>            Assignee: Manish Gupta
>
> Whenever we load dictionary data into memory, then in case of populating reverse dictionary
object sometimes a chunk which has no value is also getting added to the dictionary chunk
list. This is happening because the logic for dictionary chunk distribution in case of forward
dictionary is not implemented for reverse dictionary and 0 size dictionary chunks are not
getting removed while adding to the list of dictionary chunks.
> java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:653)
> 	at java.util.ArrayList.get(ArrayList.java:429)
> 	at org.apache.carbondata.core.cache.dictionary.DictionaryChunksWrapper.next(DictionaryChunksWrapper.java:92)
> 	at org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.prepareDictionarySortModels(CarbonDictionarySortInfoPreparator.java:120)
> 	at org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.getDictionarySortInfo(CarbonDictionarySortInfoPreparator.java:51)
> 	at org.apache.carbondata.spark.tasks.SortIndexWriterTask.execute(SortIndexWriterTask.scala:44)
> 	at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.<init>(CarbonGlobalDictionaryRDD.scala:387)
> 	at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:294)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message