carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From manishgupta88 <>
Subject [GitHub] incubator-carbondata pull request #703: [CARBONDATA-780] Alter table support...
Date Mon, 27 Mar 2017 10:32:55 GMT
GitHub user manishgupta88 opened a pull request:

    [CARBONDATA-780] Alter table support for compaction through sort step

    Alter table need to support compaction process where complete data need to be sorted again
and then written to file.
    Currently in compaction process data is directly given to writer step where it is splitted
into columns and written. But as columns are sorted from left to right, on dropping a column
data will again become unorganized as dropped column data will not be considered during compaction.
In these scenarios complete data need to be sorted again and then submitted to writer step.

You can merge this pull request into a Git repository by running:

    $ git pull compaction_restructure_support

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #703
commit b108c22024f6381385f0c394ea6ebe515a2e96b4
Author: ravikiran <>
Date:   2017-03-15T15:07:26Z

    Added class to handle sorting of data for compaction scenario

commit 11f80e3f22f68332ced85ae8da3a122d0a52447e
Author: manishgupta88 <>
Date:   2017-03-15T13:54:05Z

    Handling for compaction for restructure case. Handled to completely sort the data again
if any restructured block is selected for compaction


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message