carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lionelcao <...@git.apache.org>
Subject [GitHub] carbondata issue #1192: [CARBONDATA-940] alter table add/split partition for...
Date Wed, 26 Jul 2017 08:47:49 GMT
Github user lionelcao commented on the issue:

    https://github.com/apache/carbondata/pull/1192
  
    # Feature Description
    This feature is to support ADD & SPLIT partition function on CarbonData.
    # Scope
    Support range partition and list partition table
    # Syntax Example
    Suppose one carbon table is list partitioned on COUNTRY column.
    Current partition definition is ('China', 'US', 'UK', 'India', 'Canada, Japan, South Korea,
North Korea')
    ### add a partition
    ALTER TABLE t1 ADD PARTITION('Russia')
    ### split a partition
    ALTER TABLE t1 SPLIT PARTITION(5) INTO ('Canada', 'Japan', '(South Korea, North Korea)')
    
    # Modification
    ### parser
    added new parser to support alter table add/split partition statement
    ### validate new RangeInfo and ListInfo
    ensure new rangeInfo after adding/splitting is in correct order
    ensure new added listInfo is not existed before
    ensure the target split listInfo could be split
    ### read target partition data
    add function to read data in one segment and one partition
    ### use ALTER_PARTITION as key of temp directions
    add isAltPartitionFlow in getTempStoreLocationKey function
    ### repartition and write data
    decode the partition column and repartition
    write to new data blocks
    ### refresh cache
    drop old cache
    ### multi threads operation in different segments
    support make the changing of multiple segments in parallel.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message