carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacky Li (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CARBONDATA-1212) Memory leak in case of compaction when unsafe is true
Date Thu, 22 Jun 2017 01:29:00 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jacky Li resolved CARBONDATA-1212.
----------------------------------
    Resolution: Fixed

> Memory leak in case of compaction when unsafe is true
> -----------------------------------------------------
>
>                 Key: CARBONDATA-1212
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1212
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Manish Gupta
>            Assignee: Manish Gupta
>             Fix For: 1.2.0
>
>         Attachments: data.csv
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> In case of compaction, queryExecutor object is formed for multiple blocks but the objects
are not retained and finish method is called only on the last instance created for query executor.
Due to this the memory allocated to precious objects is not released which can lead to out
of memory issue.
> Steps to reproduce:
> ----------------------------------
> CREATE TABLE IF NOT EXISTS t3 (ID Int, date Date, country String, name String, phonetype
String, serialname char(10), salary Int) STORED BY 'carbondata' TBLPROPERTIES('DICTIONARY_EXCLUDE'='name')
> LOAD DATA LOCAL INPATH 'data.csv' into table t3
> LOAD DATA LOCAL INPATH 'data.csv' into table t3
> alter table t3 compact 'major'



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message