carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-471) Optimize no kettle flow and fix issues in cluster
Date Tue, 29 Nov 2016 18:01:59 GMT
Ravindra Pesala created CARBONDATA-471:
------------------------------------------

             Summary: Optimize no kettle flow and fix issues in cluster
                 Key: CARBONDATA-471
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-471
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ravindra Pesala


1. In non kettle flow memory usage is very high in sort step, because it keeps lots of per
every thread, it leads to GC issue.

2. Close all record readers which are opened while loading data.

3. Carbontable cannot found during data load because it is not loaded in executor, so add
the carbon table in executor side to memory.

4. Prefetch the data in inputprocessor step to avoid IO waiting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message