carbondata-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jack...@apache.org
Subject [06/14] carbondata git commit: [CARBONDATA-1993] Removed unused carbon properties high.cardinality.identify
Date Sat, 13 Jan 2018 08:10:35 GMT
[CARBONDATA-1993] Removed unused carbon properties high.cardinality.identify

This closes #1775


Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo
Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/1012c627
Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/1012c627
Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/1012c627

Branch: refs/heads/carbonstore
Commit: 1012c62742e18d7e721565a7c362c090d0888864
Parents: 3eb1e2b
Author: Pawan Malwal <pmalwal1981@gmail.com>
Authored: Mon Jan 8 16:00:47 2018 +0530
Committer: Jacky Li <jacky.likun@qq.com>
Committed: Thu Jan 11 09:37:17 2018 +0800

----------------------------------------------------------------------
 conf/carbon.properties.template       | 4 ----
 docs/configuration-parameters.md      | 2 --
 docs/data-management-on-carbondata.md | 1 -
 3 files changed, 7 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/carbondata/blob/1012c627/conf/carbon.properties.template
----------------------------------------------------------------------
diff --git a/conf/carbon.properties.template b/conf/carbon.properties.template
index de8a4ee..8c1e458 100644
--- a/conf/carbon.properties.template
+++ b/conf/carbon.properties.template
@@ -107,10 +107,6 @@ carbon.enable.quick.filter=false
 ##Min max is feature added to enhance query performance. To disable this feature, make it
false.
 #carbon.enableMinMax=true
 ######## Global Dictionary Configurations ########
-##To enable/disable identify high cardinality during first data loading
-#high.cardinality.identify.enable=true
-##threshold to identify whether high cardinality column
-#high.cardinality.threshold=1000000
 ##Percentage to identify whether column cardinality is more than configured percent of total
row count
 #high.cardinality.row.count.percentage=80
 ##The property to set the date to be considered as start date for calculating the timestamp.

http://git-wip-us.apache.org/repos/asf/carbondata/blob/1012c627/docs/configuration-parameters.md
----------------------------------------------------------------------
diff --git a/docs/configuration-parameters.md b/docs/configuration-parameters.md
index 5abfdfd..05aede7 100644
--- a/docs/configuration-parameters.md
+++ b/docs/configuration-parameters.md
@@ -130,8 +130,6 @@ This section provides the details of all the configurations required for
CarbonD
   
 | Parameter | Default Value | Description |
 |---------------------------------------|---------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-| high.cardinality.identify.enable | true | If the parameter is true, the high cardinality
columns of the dictionary code are automatically recognized and these columns will not be
used as global dictionary encoding. If the parameter is false, all dictionary encoding columns
are used as dictionary encoding. The high cardinality column must meet the following requirements:
value of cardinality > configured value of high.cardinality. <b> Note: </b>
If SINGLE_PASS is used during data load, then this property will be disabled.|
-| high.cardinality.threshold | 1000000  | It is a threshold to identify high cardinality
of the columns.If the value of columns' cardinality > the configured value, then the columns
are excluded from dictionary encoding. |
 | carbon.cutOffTimestamp | 1970-01-01 05:30:00 | Sets the start date for calculating the
timestamp. Java counts the number of milliseconds from start of "1970-01-01 00:00:00". This
property is used to customize the start of position. For example "2000-01-01 00:00:00". The
date must be in the form "carbon.timestamp.format". |
 | carbon.timegranularity | SECOND | The property used to set the data granularity level DAY,
HOUR, MINUTE, or SECOND. |
   

http://git-wip-us.apache.org/repos/asf/carbondata/blob/1012c627/docs/data-management-on-carbondata.md
----------------------------------------------------------------------
diff --git a/docs/data-management-on-carbondata.md b/docs/data-management-on-carbondata.md
index 39acfbf..0ca9289 100644
--- a/docs/data-management-on-carbondata.md
+++ b/docs/data-management-on-carbondata.md
@@ -372,7 +372,6 @@ This tutorial is going to introduce all commands and data operations on
CarbonDa
    NOTE:
    * If this option is set to TRUE then data loading will take less time.
    * If this option is set to some invalid value other than TRUE or FALSE then it uses the
default value.
-   * If this option is set to TRUE, then high.cardinality.identify.enable property will be
disabled during data load.
 
    Example:
 


Mime
View raw message