carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gvramana <>
Subject [GitHub] carbondata issue #1321: [CARBONDATA-1438] Unify the sort column and sort sco...
Date Tue, 05 Sep 2017 07:23:13 GMT
Github user gvramana commented on the issue:
    Unification for simplicity is ok. Ex: SORT_SCOPE provided in create table is default SORT_SCOPE
for that table. 
    However we have scenarios where SORT_SCOPE needs to be overridden in load command for
data load speed/streaming cases. So that compaction will bring back the scope to table level
default value.
    Option 1:
    We can decide if delete load time SORT_SCOPE and bring it back later when it is fully
    Option 2:
     Keep the syntax in data load as optional parameter and currently validate to allow only
Valid values. 
    like Data load level BATCH_SORT when table level BATCH_SORT or LOCAL_SORT is valid, as
current compaction can support this.
    currently all other cases dataload level SORT_SCOPE should be same as table level SORT_SCOPE.


View raw message