Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9110C200CAD for ; Wed, 28 Jun 2017 18:41:02 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 900AD160BF7; Wed, 28 Jun 2017 16:41:02 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C5B18160C02 for ; Wed, 28 Jun 2017 18:41:01 +0200 (CEST) Received: (qmail 24773 invoked by uid 500); 28 Jun 2017 16:41:00 -0000 Mailing-List: contact commits-help@carbondata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.apache.org Delivered-To: mailing list commits@carbondata.apache.org Received: (qmail 24506 invoked by uid 99); 28 Jun 2017 16:41:00 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Jun 2017 16:41:00 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 46DD2E96E6; Wed, 28 Jun 2017 16:40:59 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: jackylk@apache.org To: commits@carbondata.apache.org Date: Wed, 28 Jun 2017 16:41:05 -0000 Message-Id: In-Reply-To: <282e3135f31348738c7c9178a2f54ed4@git.apache.org> References: <282e3135f31348738c7c9178a2f54ed4@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [08/20] carbondata git commit: [CARBONDATA-1065] Added set command in carbon to update properties dynamically. This closes #972 archived-at: Wed, 28 Jun 2017 16:41:02 -0000 [CARBONDATA-1065] Added set command in carbon to update properties dynamically. This closes #972 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/88522912 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/88522912 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/88522912 Branch: refs/heads/encoding_override Commit: 88522912ba3248c349c7585c2ed75f70604972ef Parents: 2234ec8 39644b5 Author: Venkata Ramana G Authored: Tue Jun 27 16:21:22 2017 +0530 Committer: Venkata Ramana G Committed: Tue Jun 27 16:21:22 2017 +0530 ---------------------------------------------------------------------- .../common/constants/LoggerAction.java | 38 +++++ .../core/constants/CarbonCommonConstants.java | 100 ++++++++++- .../constants/CarbonLoadOptionConstants.java | 88 ++++++++++ .../constants/CarbonV3DataFormatConstants.java | 5 + .../InvalidConfigurationException.java | 87 ++++++++++ .../carbondata/core/util/CarbonProperties.java | 76 +++++++-- .../carbondata/core/util/CarbonProperty.java | 28 ++++ .../carbondata/core/util/CarbonSessionInfo.java | 38 +++++ .../apache/carbondata/core/util/CarbonUtil.java | 74 ++++++++- .../carbondata/core/util/SessionParams.java | 141 ++++++++++++++++ .../core/util/ThreadLocalSessionInfo.java | 34 ++++ .../hadoop/ft/CarbonInputMapperTest.java | 5 + .../carbondata/hadoop/ft/InputFilesTest.java | 5 + .../dataload/TestGlobalSortDataLoad.scala | 6 +- .../TestLoadDataWithDiffTimestampFormat.scala | 4 +- .../carbondata/spark/load/ValidateUtil.scala | 8 +- .../spark/rdd/AlterTableAddColumnRDD.scala | 5 +- .../spark/rdd/AlterTableDropColumnRDD.scala | 5 +- .../spark/rdd/CarbonCleanFilesRDD.scala | 5 +- .../spark/rdd/CarbonDeleteLoadByDateRDD.scala | 4 +- .../spark/rdd/CarbonDeleteLoadRDD.scala | 4 +- .../spark/rdd/CarbonDropTableRDD.scala | 6 +- .../spark/rdd/CarbonGlobalDictionaryRDD.scala | 19 +-- .../carbondata/spark/rdd/CarbonMergerRDD.scala | 4 +- .../apache/carbondata/spark/rdd/CarbonRDD.scala | 46 ++++++ .../carbondata/spark/rdd/CarbonScanRDD.scala | 4 +- .../spark/rdd/DataLoadCoalescedRDD.scala | 11 +- .../spark/rdd/NewCarbonDataLoadRDD.scala | 25 ++- .../spark/rdd/UpdateCoalescedRDD.scala | 7 +- .../spark/sql/catalyst/CarbonDDLSqlParser.scala | 4 +- .../spark/sql/test/TestQueryExecutor.scala | 1 + .../spark/rdd/CarbonDataRDDFactory.scala | 2 +- .../sql/CarbonDatasourceHadoopRelation.scala | 7 +- .../execution/command/carbonTableSchema.scala | 19 ++- .../spark/rdd/CarbonDataRDDFactory.scala | 2 +- .../sql/CarbonDatasourceHadoopRelation.scala | 3 + .../spark/sql/CarbonDictionaryDecoder.scala | 5 +- .../scala/org/apache/spark/sql/CarbonEnv.scala | 19 ++- .../execution/command/CarbonHiveCommands.scala | 34 +++- .../sql/execution/command/DDLStrategy.scala | 12 +- .../execution/command/carbonTableSchema.scala | 68 +++++--- .../spark/sql/hive/CarbonSessionState.scala | 2 +- .../spark/sql/internal/CarbonSqlConf.scala | 144 ++++++++++++++++ .../spark/sql/parser/CarbonSparkSqlParser.scala | 15 +- .../BadRecordPathLoadOptionTest.scala | 87 ++++++++++ .../DataLoadFailAllTypeSortTest.scala | 1 - .../commands/SetCommandTestCase.scala | 165 +++++++++++++++++++ .../processing/constants/LoggerAction.java | 38 ----- .../processing/model/CarbonLoadModel.java | 14 ++ .../newflow/DataLoadProcessBuilder.java | 3 + .../newflow/sort/SortScopeOptions.java | 17 +- .../steps/DataConverterProcessorStepImpl.java | 25 ++- ...ConverterProcessorWithBucketingStepImpl.java | 23 ++- .../util/CarbonDataProcessorUtil.java | 16 +- .../carbon/datastore/BlockIndexStoreTest.java | 3 +- 55 files changed, 1404 insertions(+), 207 deletions(-) ----------------------------------------------------------------------