carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "suo tong (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-436) change blocklet size related to the raw size of data
Date Tue, 22 Nov 2016 10:09:58 GMT
suo tong created CARBONDATA-436:
-----------------------------------

             Summary: change blocklet size related to the raw size of data 
                 Key: CARBONDATA-436
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-436
             Project: CarbonData
          Issue Type: Sub-task
            Reporter: suo tong
            Assignee: QiangCai


Currently, the blocklet size is the row counts in the blocklet. The default value(120000)
is small for hdfs io. If we increase the value, which may cause too many Young-GC when we
scan many columns. Like parquet, its row group size can be configed, and using hdfs block
size as its default value.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message