carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "kumar vishal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-241) OOM error during query execution in long run
Date Thu, 15 Sep 2016 08:52:20 GMT
kumar vishal created CARBONDATA-241:
---------------------------------------

             Summary: OOM error during query execution in long run
                 Key: CARBONDATA-241
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-241
             Project: CarbonData
          Issue Type: Bug
            Reporter: kumar vishal
            Assignee: kumar vishal


**Problem:** During long run query execution is taking more time and it is throwing out of
memory issue.
**Reason**: In compaction we are compacting segments and each segment metadata is loaded in
memory. So after compaction compacted segments are invalid but its meta data is not removed
from memory because of this duplicate metadata is pile up and it is taking more memory and
after few days query exeution is throwing OOM
**Solution**: Need to remove invalid blocks from memory

 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message