carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gururaj Shetty (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-207) The document of "DDL operations on CarbonData", "MINOR/MAJOR" in compaction section need to provide more detail explanation
Date Thu, 22 Sep 2016 11:47:20 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513058#comment-15513058
] 

Gururaj Shetty commented on CARBONDATA-207:
-------------------------------------------

Can add more details in Usage Guideline about Minor and Major compaction. 
Below is the draft and the same can be updated in the .md files.

Minor Compaction:
In Minor compaction, you can specify number of loads to be merged (compacted). Minor compaction
triggers for every data load if the parameter carbon.enable.auto.load.merge is set. If any
segments are available to be merged, then compaction will run parallel with data load. There
are 2 levels in minor compaction.
•	Level 1: Merging of the segments which are not yet compacted.
•	Level 2: Merging of the compacted segments again to form a bigger segment.

Major Compaction:
In Major compaction, many segments can be merged into one big segment. You can specify the
compaction size until which the segments will be merged.  Major compaction is usually done
during the off-peak time.



> The document of "DDL operations on CarbonData", "MINOR/MAJOR" in compaction section need
to provide more detail explanation
> ---------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-207
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-207
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: docs
>    Affects Versions: 0.1.0-incubating, 0.2.0-incubating
>            Reporter: ChenLiang
>            Priority: Minor
>             Fix For: 0.2.0-incubating, 0.1.1-incubating
>
>
> The document of "DDL operations on CarbonData", "MINOR/MAJOR" in compaction section need
to provide more detail explanation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message