Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 38C9C200C82 for ; Fri, 12 May 2017 14:27:13 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 37483160BB8; Fri, 12 May 2017 12:27:13 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D5E11160BA3 for ; Fri, 12 May 2017 14:27:11 +0200 (CEST) Received: (qmail 43489 invoked by uid 500); 12 May 2017 12:27:11 -0000 Mailing-List: contact commits-help@carbondata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.apache.org Delivered-To: mailing list commits@carbondata.apache.org Received: (qmail 43478 invoked by uid 99); 12 May 2017 12:27:11 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 May 2017 12:27:11 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id ED587DFFB2; Fri, 12 May 2017 12:27:10 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: chenliang613@apache.org To: commits@carbondata.apache.org Date: Fri, 12 May 2017 12:27:10 -0000 Message-Id: X-Mailer: ASF-Git Admin Mailer Subject: [1/3] carbondata-site git commit: Updated the User and Dev Mail Chains and CarbonScript file archived-at: Fri, 12 May 2017 12:27:13 -0000 Repository: carbondata-site Updated Branches: refs/heads/asf-site 51c60829c -> b370052b3 Updated the User and Dev Mail Chains and CarbonScript file Project: http://git-wip-us.apache.org/repos/asf/carbondata-site/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata-site/commit/8220913d Tree: http://git-wip-us.apache.org/repos/asf/carbondata-site/tree/8220913d Diff: http://git-wip-us.apache.org/repos/asf/carbondata-site/diff/8220913d Branch: refs/heads/asf-site Commit: 8220913d59b9da116308ddc8ee2c053d1fdc2bd9 Parents: 51c6082 Author: PallaviSingh1992 Authored: Fri May 12 12:51:37 2017 +0530 Committer: PallaviSingh1992 Committed: Fri May 12 13:05:29 2017 +0530 ---------------------------------------------------------------------- carbonscript.sh | 2 +- src/main/scala/MdFilehandler.scala | 54 -------------------- src/main/webapp/configuration-parameters.html | 4 -- src/main/webapp/css/style.css | 11 ++++ src/main/webapp/data-management.html | 6 +-- .../webapp/ddl-operation-on-carbondata.html | 12 ++--- .../webapp/dml-operation-on-carbondata.html | 4 -- src/main/webapp/faq.html | 6 +-- .../webapp/file-structure-of-carbondata.html | 6 +-- src/main/webapp/index.html | 36 +++++++------ src/main/webapp/installation-guide.html | 6 +-- src/main/webapp/js/custom.js | 10 ++-- src/main/webapp/quick-start-guide.html | 4 -- .../supported-data-types-in-carbondata.html | 4 -- src/main/webapp/troubleshooting.html | 6 +-- src/main/webapp/useful-tips-on-carbondata.html | 4 -- 16 files changed, 45 insertions(+), 130 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/carbonscript.sh ---------------------------------------------------------------------- diff --git a/carbonscript.sh b/carbonscript.sh index b1ad576..0ec7143 100755 --- a/carbonscript.sh +++ b/carbonscript.sh @@ -1,5 +1,5 @@ mvn compile -mvn exec:java -Dexec.mainClass=FileOperationMain +mvn exec:java -Dexec.mainClass=WebsiteLauncher mvn install http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/scala/MdFilehandler.scala ---------------------------------------------------------------------- diff --git a/src/main/scala/MdFilehandler.scala b/src/main/scala/MdFilehandler.scala deleted file mode 100644 index 6fae74e..0000000 --- a/src/main/scala/MdFilehandler.scala +++ /dev/null @@ -1,54 +0,0 @@ -import com.google.inject.Inject -import org.slf4j.{Logger, LoggerFactory} -import services.{FileService, ConfService} - -import scala.util.matching.Regex - -class MdFileHandler @Inject()(confService: ConfService, fileService: FileService) { - - val logger: Logger = LoggerFactory.getLogger(classOf[MdFileHandler]) - - /** - * converts .md extension to .html extension - * changes location of image from local to git repository - * - * @param input - * @return contents of file - */ - def convertMdExtensions(input: String): String = { - val modifyContentPattern: Regex = new Regex("id=\"user-content-") - val modifyMdPattern: Regex = new Regex(".md") - val modifyImagePattern: Regex = new Regex(" - val fileURLContent: String = fileService.readFromFile("src/main/webapp/" + file + outputFileExtension) - val fileContent: String = modifyMdPattern replaceAllIn(fileURLContent, "$1.md") - fileService.writeToFile(location + file + outputFileExtension, fileContent) - fileContent - } - - } - -} - http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/configuration-parameters.html ---------------------------------------------------------------------- diff --git a/src/main/webapp/configuration-parameters.html b/src/main/webapp/configuration-parameters.html index 66d3da3..b943b31 100644 --- a/src/main/webapp/configuration-parameters.html +++ b/src/main/webapp/configuration-parameters.html @@ -76,11 +76,7 @@ Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide
  • Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide
  • carbon.numberof.preserve.segments 0 Minor/Major -If the user wants to preserve some number of segments from being compacted then he can set this property. Example: carbon.numberof.preserve.segments=2 then 2 latest segments will always be excluded from the compaction. No segments will be preserved by default. +This property configures number of segments to preserve from being compacted. Example: carbon.numberof.preserve.segments=2 then 2 latest segments will always be excluded from the compaction. No segments will be preserved by default. 0-100 http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/ddl-operation-on-carbondata.html ---------------------------------------------------------------------- diff --git a/src/main/webapp/ddl-operation-on-carbondata.html b/src/main/webapp/ddl-operation-on-carbondata.html index 04fdb51..4a94fa8 100644 --- a/src/main/webapp/ddl-operation-on-carbondata.html +++ b/src/main/webapp/ddl-operation-on-carbondata.html @@ -76,11 +76,7 @@ Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide

    • Inverted Index Configuration

      -

      Inverted index is very useful to improve compression ratio and query speed, especially for those low-cardinality columns who are in reward position. +

      Inverted index is very useful to improve compression ratio and query speed, especially for those low-cardinality columns which are in reward position. By default inverted index is enabled. The user can disable the inverted index creation for some columns.

    @@ -533,7 +529,7 @@ By default inverted index is enabled. The user can disable the inverted index cr     Valid Scenarios
    • -

      Invalid scenario - Change of decimal precision from (10,2) to (10,5) is not valid as in this case only scale is increased but total number of digits remain the same.

      +

      Invalid scenario - Change of decimal precision from (10,2) to (10,5) is invalid as in this case only scale is increased but total number of digits remains the same.

    • Valid scenario - Change of decimal precision from (10,2) to (12,3) is valid as the total number of digits are increased by 2 but scale is increased only by 1 which will not lead to any data loss.

      @@ -631,7 +627,7 @@ By default inverted index is enabled. The user can disable the inverted index cr BUCKETING

      Bucketing feature can be used to distribute/organize the table/partition data into multiple files such that similar records are present in the same file. While creating a table, a user needs to specify the -columns to be used for bucketing and the number of buckets. For the selction of bucket the Hash value +columns to be used for bucketing and the number of buckets. For the selection of bucket the Hash value of columns is used.

         CREATE TABLE [IF NOT EXISTS] [db_name.]table_name
                     [(col_name data_type, ...)]
@@ -676,7 +672,7 @@ of columns is used.

    -Example :

    +Example: 
     CREATE TABLE IF NOT EXISTS productSchema.productSalesTable (
                                 productNumber Int,
                                 saleQuantity Int,

http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/dml-operation-on-carbondata.html
----------------------------------------------------------------------
diff --git a/src/main/webapp/dml-operation-on-carbondata.html b/src/main/webapp/dml-operation-on-carbondata.html
index 830fb3e..c404840 100644
--- a/src/main/webapp/dml-operation-on-carbondata.html
+++ b/src/main/webapp/dml-operation-on-carbondata.html
@@ -76,11 +76,7 @@
                                 Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide
  • Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide
  • INSERT INTO TABLE carbon_table SELECT id, city FROM source_table;

    Scenario 3 :

    -

    When the column type in carbon table is different from from the column specified in select statement. The insert operation will still success, but you may get NULL in result, because NULL will be substitute value when conversion type failed.

    +

    When the column type in carbon table is different from the column specified in select statement. The insert operation will still success, but you may get NULL in result, because NULL will be substitute value when conversion type failed.

    http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/file-structure-of-carbondata.html ---------------------------------------------------------------------- diff --git a/src/main/webapp/file-structure-of-carbondata.html b/src/main/webapp/file-structure-of-carbondata.html index 30d3c6f..996d6f5 100644 --- a/src/main/webapp/file-structure-of-carbondata.html +++ b/src/main/webapp/file-structure-of-carbondata.html @@ -76,11 +76,7 @@     Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide
  • File Header : It contains CarbonData file version number, list of column schema and schema updation timestamp.
  • File Footer : it contains Number of rows, segmentinfo ,all blocklets? info and index, you can find the detail from the below diagram.
  • Blocklet : Rows are grouped to form a blocklet, the size of the blocklet is configurable and default size is 64MB, Blocklet contains Column Page groups for each column.
    • -
  • Column Page Group : Data of one column and it is further divided to pages, it is guaranteed to be contiguous in file.
    • +
  • Column Page Group : Data of one column and it is further divided into pages, it is guaranteed to be contiguous in file.
  • Page : It has the data of one column and the number of row is fixed to 32000 size.

    • CarbonData File Format

    http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/index.html ---------------------------------------------------------------------- diff --git a/src/main/webapp/index.html b/src/main/webapp/index.html index 2f9db8c..e313d38 100644 --- a/src/main/webapp/index.html +++ b/src/main/webapp/index.html @@ -395,24 +395,9 @@ to join the community and contribute to CarbonData.

    -

    It is very easy to join CarbonData community: -

    + +

    Mailing Lists + +

    + + + http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/installation-guide.html ---------------------------------------------------------------------- diff --git a/src/main/webapp/installation-guide.html b/src/main/webapp/installation-guide.html index 300b6b0..5bc678f 100644 --- a/src/main/webapp/installation-guide.html +++ b/src/main/webapp/installation-guide.html @@ -76,11 +76,7 @@ Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide
  • Connecting to CarbonData Thrift Server Using Beeline. 
         cd $SPARK_HOME
-     ./bin/beeline jdbc:hive2://<thrftserver_host>:port
+     ./bin/beeline jdbc:hive2://<thriftserver_host>:port
 
      Example
      ./bin/beeline jdbc:hive2://10.10.10.10:10000

http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/js/custom.js
----------------------------------------------------------------------
diff --git a/src/main/webapp/js/custom.js b/src/main/webapp/js/custom.js
index e074dd4..734837b 100644
--- a/src/main/webapp/js/custom.js
+++ b/src/main/webapp/js/custom.js
@@ -15,8 +15,8 @@ $(document).ready(function(){
 
 // Documentation page perticular links from landing page
 /*-----------------------------------------------------------*/
- 
-function getParameterByName(name, url) {
+
+/*function getParameterByName(name, url) {
     if (!url) {
       url = window.location.href;
     }
@@ -26,7 +26,7 @@ function getParameterByName(name, url) {
     if (!results) return null;
     if (!results[2]) return '';
     return decodeURIComponent(results[2].replace(/\+/g, " "));
-}
+}*/
 
 // conditional loading of documentation page from landing page
 $(document).ready(function(){
@@ -59,8 +59,8 @@ $(document).ready(function(){
       pagelink ="data-management.html"
       break;
 
-      } 
-    $("#viewpage").load(pagelink);  
+      }
+    $("#viewpage").load(pagelink);
 
  });
 

http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/quick-start-guide.html
----------------------------------------------------------------------
diff --git a/src/main/webapp/quick-start-guide.html b/src/main/webapp/quick-start-guide.html
index e125977..214d3e8 100644
--- a/src/main/webapp/quick-start-guide.html
+++ b/src/main/webapp/quick-start-guide.html
@@ -76,11 +76,7 @@
                                 Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide
  • Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide
  • Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide

  • Procedure

    Ensure that the Hiveuser in mysql must allow its access to the external processes.

    -Failure to read the metastore db during table creation.

    +Failed to read the metastore db during table creation.

    Symptom

    We get the following exception on trying to connect :

    Cannot read the metastore db

http://git-wip-us.apache.org/repos/asf/carbondata-site/blob/8220913d/src/main/webapp/useful-tips-on-carbondata.html
----------------------------------------------------------------------
diff --git a/src/main/webapp/useful-tips-on-carbondata.html b/src/main/webapp/useful-tips-on-carbondata.html
index cc8110c..e7d9bcb 100644
--- a/src/main/webapp/useful-tips-on-carbondata.html
+++ b/src/main/webapp/useful-tips-on-carbondata.html
@@ -76,11 +76,7 @@
                                 Contributing to CarbonData
  • -<<<<<<< HEAD >>>>>> pr-34 target="_blank">Release Guide