carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "kumar vishal (JIRA)" <>
Subject [jira] [Created] (CARBONDATA-1515) Fixed NPE in Data loading
Date Mon, 25 Sep 2017 13:06:00 GMT
kumar vishal created CARBONDATA-1515:

             Summary: Fixed NPE in Data loading
                 Key: CARBONDATA-1515
             Project: CarbonData
          Issue Type: Bug
            Reporter: kumar vishal
            Assignee: kumar vishal

Data size: 3.5 billion rows(4.1 tb data)
3 node cluster
Number of core while data loading 12.
No. of loads 100 times
Problem: In DataConverterProcessorStepImpl it is using array list for adding all the local
converter, in case of multiple thread scenario it is creating a hole (null value)(as array
list if not synchronized). while closing the converter it is it is throwing NPE
Solution: Add local converter in synchronized block

This message was sent by Atlassian JIRA

View raw message