Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 737A5200CCB for ; Thu, 20 Jul 2017 15:04:35 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 720B116B48D; Thu, 20 Jul 2017 13:04:35 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E145516B48E for ; Thu, 20 Jul 2017 15:04:33 +0200 (CEST) Received: (qmail 12918 invoked by uid 500); 20 Jul 2017 13:04:32 -0000 Mailing-List: contact commits-help@carbondata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.apache.org Delivered-To: mailing list commits@carbondata.apache.org Received: (qmail 12811 invoked by uid 99); 20 Jul 2017 13:04:32 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Jul 2017 13:04:32 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 35E0DE96B1; Thu, 20 Jul 2017 13:04:32 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: chenliang613@apache.org To: commits@carbondata.apache.org Date: Thu, 20 Jul 2017 13:04:34 -0000 Message-Id: <0083f5c57cdf4fb0b78ae02f2882b430@git.apache.org> In-Reply-To: <0ba1c4a8cc734a129c306b5f0e37abe6@git.apache.org> References: <0ba1c4a8cc734a129c306b5f0e37abe6@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [3/3] carbondata-site git commit: add 1.1.1 release info archived-at: Thu, 20 Jul 2017 13:04:35 -0000 add 1.1.1 release info Project: http://git-wip-us.apache.org/repos/asf/carbondata-site/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata-site/commit/b41bbc68 Tree: http://git-wip-us.apache.org/repos/asf/carbondata-site/tree/b41bbc68 Diff: http://git-wip-us.apache.org/repos/asf/carbondata-site/diff/b41bbc68 Branch: refs/heads/asf-site Commit: b41bbc68b54b10bbc1df38016eeb4984e6c713ff Parents: 5fc9ff5 Author: chenliang613 Authored: Thu Jul 20 21:04:22 2017 +0800 Committer: chenliang613 Committed: Thu Jul 20 21:04:22 2017 +0800 ---------------------------------------------------------------------- content/configuration-parameters.html | 10 +-- content/data-management.html | 3 + content/ddl-operation-on-carbondata.html | 3 + content/dml-operation-on-carbondata.html | 3 + content/faq.html | 3 + content/file-structure-of-carbondata.html | 3 + content/index.html | 19 +++-- content/installation-guide.html | 3 + content/mainpage.html | 3 + content/quick-start-guide.html | 3 + content/security.html | 4 + content/supported-data-types-in-carbondata.html | 4 + content/troubleshooting.html | 3 + content/useful-tips-on-carbondata.html | 86 +++++++++++++------- content/videogallery.html | 3 + 15 files changed, 109 insertions(+), 44 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/configuration-parameters.html ---------------------------------------------------------------------- diff --git a/content/configuration-parameters.html b/content/configuration-parameters.html index 233a59b..96a91c6 100644 --- a/content/configuration-parameters.html +++ b/content/configuration-parameters.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
  • + Apache CarbonData 1.1.1
    • +
  • Apache CarbonData 1.1.0
  • @@ -540,7 +543,7 @@ high.cardinality.identify.enable true -If the parameter is true, the high cardinality columns of the dictionary code are automatically recognized and these columns will not be used as global dictionary encoding. If the parameter is false, all dictionary encoding columns are used as dictionary encoding. The high cardinality column must meet the following requirements: value of cardinality > configured value of high.cardinality. Equally, the value of cardinality is higher than the threshold.value of cardinality/ row number x 100 > configured value of high.cardinality.row.count.percentage. Equally, the ratio of the cardinality value to data row number is higher than the configured percentage. Note: If SINGLE_PASS is used during data load, then this property will be disabled. +If the parameter is true, the high cardinality columns of the dictionary code are automatically recognized and these columns will not be used as global dictionary encoding. If the parameter is false, all dictionary encoding columns are used as dictionary encoding. The high cardinality column must meet the following requirements: value of cardinality > configured value of high.cardinality. Note: If SINGLE_PASS is used during data load, then this property will be disabled. high.cardinality.threshold @@ -548,11 +551,6 @@ It is a threshold to identify high cardinality of the columns.If the value of columns' cardinality > the configured value, then the columns are excluded from dictionary encoding. -high.cardinality.row.count.percentage -80 -Percentage to identify whether column cardinality is more than configured percent of total row count.Configuration value formula:Value of cardinality/ row number x 100 > configured value of high.cardinality.row.count.percentage. The value of the parameter must be larger than 0. - - carbon.cutOffTimestamp 1970-01-01 05:30:00 Sets the start date for calculating the timestamp. Java counts the number of milliseconds from start of "1970-01-01 00:00:00". This property is used to customize the start of position. For example "2000-01-01 00:00:00". The date must be in the form "carbon.timestamp.format". NOTE: The CarbonData supports data store up to 68 years from the cut-off time defined. For example, if the cut-off time is 1970-01-01 05:30:00, then the data can be stored up to 2038-01-01 05:30:00. http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/data-management.html ---------------------------------------------------------------------- diff --git a/content/data-management.html b/content/data-management.html index f835e12..ec1d60c 100644 --- a/content/data-management.html +++ b/content/data-management.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
    • + Apache CarbonData 1.1.1
      • +
    • Apache CarbonData 1.1.0
    • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/ddl-operation-on-carbondata.html ---------------------------------------------------------------------- diff --git a/content/ddl-operation-on-carbondata.html b/content/ddl-operation-on-carbondata.html index 633115d..5c0cd9e 100644 --- a/content/ddl-operation-on-carbondata.html +++ b/content/ddl-operation-on-carbondata.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
      • + Apache CarbonData 1.1.1
        • +
      • Apache CarbonData 1.1.0
      • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/dml-operation-on-carbondata.html ---------------------------------------------------------------------- diff --git a/content/dml-operation-on-carbondata.html b/content/dml-operation-on-carbondata.html index cb62bcd..8e044ae 100644 --- a/content/dml-operation-on-carbondata.html +++ b/content/dml-operation-on-carbondata.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
        • + Apache CarbonData 1.1.1
          • +
        • Apache CarbonData 1.1.0
        • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/faq.html ---------------------------------------------------------------------- diff --git a/content/faq.html b/content/faq.html index 84a118d..4e8ce49 100644 --- a/content/faq.html +++ b/content/faq.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
          • + Apache CarbonData 1.1.1
            • +
          • Apache CarbonData 1.1.0
          • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/file-structure-of-carbondata.html ---------------------------------------------------------------------- diff --git a/content/file-structure-of-carbondata.html b/content/file-structure-of-carbondata.html index 3567f59..449771e 100644 --- a/content/file-structure-of-carbondata.html +++ b/content/file-structure-of-carbondata.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
            • + Apache CarbonData 1.1.1
              • +
            • Apache CarbonData 1.1.0
            • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/index.html ---------------------------------------------------------------------- diff --git a/content/index.html b/content/index.html index 47d7987..3365338 100644 --- a/content/index.html +++ b/content/index.html @@ -54,6 +54,9 @@ class="caret">
              • + Apache CarbonData 1.1.1
                • +
              • Apache CarbonData 1.1.0
              • @@ -299,6 +302,13 @@
                + Apache CarbonData 1.1.1 + July 2017 + what's new +
                +
                Apache CarbonData 1.1.0 May 2017 @@ -312,13 +322,6 @@ what's new
                -
                - Apache CarbonData 0.2.0-incubating - Nov 2016 - what's new -
                @@ -451,7 +454,7 @@ to do is:

                1. - Download the latest release.
                  2. http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/installation-guide.html ---------------------------------------------------------------------- diff --git a/content/installation-guide.html b/content/installation-guide.html index a8d9872..e3ea160 100644 --- a/content/installation-guide.html +++ b/content/installation-guide.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
                  • + Apache CarbonData 1.1.1
                    • +
                  • Apache CarbonData 1.1.0
                  • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/mainpage.html ---------------------------------------------------------------------- diff --git a/content/mainpage.html b/content/mainpage.html index 436e5fc..f0056fe 100644 --- a/content/mainpage.html +++ b/content/mainpage.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
                    • + Apache CarbonData 1.1.1
                      • +
                    • Apache CarbonData 1.1.0
                    • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/quick-start-guide.html ---------------------------------------------------------------------- diff --git a/content/quick-start-guide.html b/content/quick-start-guide.html index 8c7a1b7..d26b28e 100644 --- a/content/quick-start-guide.html +++ b/content/quick-start-guide.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
                      • + Apache CarbonData 1.1.1
                        • +
                      • Apache CarbonData 1.1.0
                      • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/security.html ---------------------------------------------------------------------- diff --git a/content/security.html b/content/security.html index 8dba763..cde2a24 100644 --- a/content/security.html +++ b/content/security.html @@ -45,6 +45,9 @@ aria-expanded="false">Download
                        • + Apache CarbonData 1.1.1
                          • +
                        • Apache CarbonData 1.1.0
                        • @@ -69,6 +72,7 @@
                            +
                          • Contributing to CarbonData
                            • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/supported-data-types-in-carbondata.html ---------------------------------------------------------------------- diff --git a/content/supported-data-types-in-carbondata.html b/content/supported-data-types-in-carbondata.html index 9ec0e9a..6d43c99 100644 --- a/content/supported-data-types-in-carbondata.html +++ b/content/supported-data-types-in-carbondata.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
                            • + Apache CarbonData 1.1.1
                              • +
                            • Apache CarbonData 1.1.0
                            • @@ -189,6 +192,7 @@
                              • STRING
                              • CHAR
                                • +
                              • VARCHAR
                            • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/troubleshooting.html ---------------------------------------------------------------------- diff --git a/content/troubleshooting.html b/content/troubleshooting.html index fd2cc95..d9a66cf 100644 --- a/content/troubleshooting.html +++ b/content/troubleshooting.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
                              • + Apache CarbonData 1.1.1
                                • +
                              • Apache CarbonData 1.1.0
                              • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/useful-tips-on-carbondata.html ---------------------------------------------------------------------- diff --git a/content/useful-tips-on-carbondata.html b/content/useful-tips-on-carbondata.html index 29235a2..6277ff8 100644 --- a/content/useful-tips-on-carbondata.html +++ b/content/useful-tips-on-carbondata.html @@ -51,6 +51,9 @@ aria-expanded="false"> Download
                                • + Apache CarbonData 1.1.1
                                  • +
                                • Apache CarbonData 1.1.0
                                • @@ -246,6 +249,15 @@ The create table command can be modified as suggested below :

                                  )STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,..', 'DICTIONARY_INCLUDE'='...'); + + Example: + create table carbondata_table( + msisdn String, + BEGIN_TIME bigint + )STORED BY 'org.apache.carbondata.format' + TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN', + 'DICTIONARY_INCLUDE'='BEGIN_TIME'); +

                                  Now the query with MSISDN in the filter will be more efficient.

                                    @@ -267,6 +279,17 @@ The create table command can be modified as suggested below :

                                    )STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,HOST..', 'DICTIONARY_INCLUDE'='Dime_1..'); + + Example: + create table carbondata_table( + Dime_1 String, + HOST String, + MSISDN String + )STORED BY 'org.apache.carbondata.format' + TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,HOST', + 'DICTIONARY_INCLUDE'='Dime_1'); + +
                                    • @@ -276,14 +299,15 @@ The create table command can be modified as below :

                                      create table carbondata_table(
-  Dime_1 String,
-  BEGIN_TIME bigint,
-  HOST String,
-  MSISDN String,
-  ...
-  )STORED BY 'org.apache.carbondata.format'
-  TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,HOST,IMSI..',
-  'DICTIONARY_INCLUDE'='Dime_1,END_TIME,BEGIN_TIME..');
+    Dime_1 String,
+    BEGIN_TIME bigint,
+    END_TIME bigint,
+    HOST String,
+    MSISDN String
+    ...
+    )STORED BY 'org.apache.carbondata.format'
+    TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,HOST...',
+    'DICTIONARY_INCLUDE'='Dime_1,END_TIME,BEGIN_TIME...');
                                    • @@ -293,17 +317,18 @@ query performance. The create table command can be modified as below :

                                      create table carbondata_table(
-  Dime_1 String,
-  BEGIN_TIME bigint,
-  HOST String,
-  MSISDN String,
-  counter_1 double,
-  counter_2 double,
-  ...
-  counter_100 double
-  )STORED BY 'org.apache.carbondata.format'
-  TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,HOST,IMSI',
-  'DICTIONARY_INCLUDE'='Dime_1,END_TIME,BEGIN_TIME');
+    Dime_1 String,
+    BEGIN_TIME bigint,
+    END_TIME bigint,
+    HOST String,
+    MSISDN String,
+    counter_1 double,
+    counter_2 double,
+    ...
+    counter_100 double
+    )STORED BY 'org.apache.carbondata.format'
+    TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,HOST...',
+    'DICTIONARY_INCLUDE'='Dime_1,END_TIME,BEGIN_TIME...');

                                    The result of performance analysis of test-case shows reduction in query execution time from 15 to 3 seconds, thereby improving performance by nearly 5 times.

                                      @@ -315,17 +340,18 @@ suggested to put begin_time at the end of dimensions.

                                      create table carbondata_table(
-  Dime_1 String,
-  HOST String,
-  MSISDN String,
-  counter_1 double,
-  counter_2 double,
-  BEGIN_TIME bigint,
-  ...
-  counter_100 double
-  )STORED BY 'org.apache.carbondata.format'
-  TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,HOST,IMSI',
-  'DICTIONARY_INCLUDE'='Dime_1,END_TIME,BEGIN_TIME');
+    Dime_1 String,
+    HOST String,
+    MSISDN String,
+    counter_1 double,
+    counter_2 double,
+    BEGIN_TIME bigint,
+    END_TIME bigint,
+    ...
+    counter_100 double
+    )STORED BY 'org.apache.carbondata.format'
+    TBLPROPERTIES ( 'DICTIONARY_EXCLUDE'='MSISDN,HOST...',
+    'DICTIONARY_INCLUDE'='Dime_1,END_TIME,BEGIN_TIME....');
                                    • http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/b41bbc68/content/videogallery.html ---------------------------------------------------------------------- diff --git a/content/videogallery.html b/content/videogallery.html index 8d21f8e..4a21372 100644 --- a/content/videogallery.html +++ b/content/videogallery.html @@ -49,6 +49,9 @@ aria-expanded="false"> Download