Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6354F200BD4 for ; Thu, 1 Dec 2016 09:17:18 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 62061160B0F; Thu, 1 Dec 2016 08:17:18 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B2BD3160B0B for ; Thu, 1 Dec 2016 09:17:17 +0100 (CET) Received: (qmail 58423 invoked by uid 500); 1 Dec 2016 08:17:17 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 58413 invoked by uid 99); 1 Dec 2016 08:17:16 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Dec 2016 08:17:16 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 5E431180554 for ; Thu, 1 Dec 2016 08:17:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -7.018 X-Spam-Level: X-Spam-Status: No, score=-7.018 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id dwlKb1N3Xr2c for ; Thu, 1 Dec 2016 08:17:14 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 7D6E35F47D for ; Thu, 1 Dec 2016 08:17:13 +0000 (UTC) Received: (qmail 58385 invoked by uid 99); 1 Dec 2016 08:17:12 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Dec 2016 08:17:12 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 98244DFC47; Thu, 1 Dec 2016 08:17:12 +0000 (UTC) From: jackylk To: issues@carbondata.incubator.apache.org Reply-To: issues@carbondata.incubator.apache.org References: In-Reply-To: Subject: [GitHub] incubator-carbondata pull request #265: [CARBONDATA-458]Improving First time... Content-Type: text/plain Message-Id: <20161201081712.98244DFC47@git1-us-west.apache.org> Date: Thu, 1 Dec 2016 08:17:12 +0000 (UTC) archived-at: Thu, 01 Dec 2016 08:17:18 -0000 Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/265#discussion_r90399963 --- Diff: core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java --- @@ -814,85 +810,86 @@ * Rocord size in case of compaction. */ public static final int COMPACTION_INMEMORY_RECORD_SIZE = 120000; - - /** - * If the level 2 compaction is done in minor then new compacted segment will end with .2 - */ - public static String LEVEL2_COMPACTION_INDEX = ".2"; - - /** - * Indicates compaction - */ - public static String COMPACTION_KEY_WORD = "COMPACTION"; - /** * hdfs temporary directory key */ public static final String HDFS_TEMP_LOCATION = "hadoop.tmp.dir"; - /** * zookeeper url key */ public static final String ZOOKEEPER_URL = "spark.deploy.zookeeper.url"; - /** * configure the minimum blocklet size eligible for blocklet distribution */ public static final String CARBON_BLOCKLETDISTRIBUTION_MIN_REQUIRED_SIZE = "carbon.blockletdistribution.min.blocklet.size"; - /** * default blocklet size eligible for blocklet distribution */ public static final int DEFAULT_CARBON_BLOCKLETDISTRIBUTION_MIN_REQUIRED_SIZE = 2; - + /** + * This batch size is used to send rows from load step to another step in batches. + */ + public static final String DATA_LOAD_BATCH_SIZE = "DATA_LOAD_BATCH_SIZE"; + /** + * Default size of data load batch size. + */ + public static final String DATA_LOAD_BATCH_SIZE_DEFAULT = "1000"; + /** + * carbon data file version property + */ + public static final String CARBON_DATA_FILE_VERSION = "carbon.data.file.version"; + /** + * current data file version + */ + public static final short CARBON_DATA_FILE_CURRENT_VERSION = 2; --- End diff -- change 2 to enum also --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---