carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CARBONDATA-1515) Fixed NPE in Data loading
Date Tue, 26 Sep 2017 14:48:00 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravindra Pesala resolved CARBONDATA-1515.
-----------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.3.0

> Fixed NPE in Data loading
> -------------------------
>
>                 Key: CARBONDATA-1515
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1515
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: kumar vishal
>            Assignee: kumar vishal
>             Fix For: 1.3.0
>
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> Scenario: 
> Data size: 3.5 billion rows(4.1 tb data)
> 3 node cluster
> Number of core while data loading 12.
> No. of loads 100 times
> Problem: In DataConverterProcessorStepImpl it is using array list for adding all the
local converter, in case of multiple thread scenario it is creating a hole (null value)(as
array list if not synchronized). while closing the converter it is it is throwing NPE
> Solution: Add local converter in synchronized block



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message