carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "kumar vishal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-1515) Fixed NPE in Data loading
Date Mon, 25 Sep 2017 13:06:00 GMT
kumar vishal created CARBONDATA-1515:
----------------------------------------

             Summary: Fixed NPE in Data loading
                 Key: CARBONDATA-1515
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1515
             Project: CarbonData
          Issue Type: Bug
            Reporter: kumar vishal
            Assignee: kumar vishal


Scenario: 
Data size: 3.5 billion rows(4.1 tb data)
3 node cluster
Number of core while data loading 12.
No. of loads 100 times
Problem: In DataConverterProcessorStepImpl it is using array list for adding all the local
converter, in case of multiple thread scenario it is creating a hole (null value)(as array
list if not synchronized). while closing the converter it is it is throwing NPE
Solution: Add local converter in synchronized block






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message