carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manish Gupta (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-1212) Memory leak in case of compaction when unsafe is true
Date Wed, 21 Jun 2017 14:56:00 GMT
Manish Gupta created CARBONDATA-1212:
----------------------------------------

             Summary: Memory leak in case of compaction when unsafe is true
                 Key: CARBONDATA-1212
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1212
             Project: CarbonData
          Issue Type: Bug
            Reporter: Manish Gupta
            Assignee: Manish Gupta
             Fix For: 1.2.0
         Attachments: data.csv

In case of compaction, queryExecutor object is formed for multiple blocks but the objects
are not retained and finish method is called only on the last instance created for query executor.
Due to this the memory allocated to precious objects is not released which can lead to out
of memory issue.

Steps to reproduce:
----------------------------------
CREATE TABLE IF NOT EXISTS t3 (ID Int, date Date, country String, name String, phonetype String,
serialname char(10), salary Int) STORED BY 'carbondata' TBLPROPERTIES('DICTIONARY_EXCLUDE'='name')
LOAD DATA LOCAL INPATH 'data.csv' into table t3
LOAD DATA LOCAL INPATH 'data.csv' into table t3
alter table t3 compact 'major'




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message