Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 06EA2200C3D for ; Tue, 14 Mar 2017 08:08:08 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 05929160B7E; Tue, 14 Mar 2017 07:08:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4EAD1160B7C for ; Tue, 14 Mar 2017 08:08:07 +0100 (CET) Received: (qmail 88800 invoked by uid 500); 14 Mar 2017 07:08:06 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 88791 invoked by uid 99); 14 Mar 2017 07:08:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Mar 2017 07:08:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id A1FDE1AFAD5 for ; Tue, 14 Mar 2017 07:08:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.02 X-Spam-Level: X-Spam-Status: No, score=-4.02 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id kt227fcTamUI for ; Tue, 14 Mar 2017 07:08:04 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id EF7645F252 for ; Tue, 14 Mar 2017 07:08:03 +0000 (UTC) Received: (qmail 88778 invoked by uid 99); 14 Mar 2017 07:08:03 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Mar 2017 07:08:03 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id DC91EDFE1E; Tue, 14 Mar 2017 07:08:02 +0000 (UTC) From: jackylk To: issues@carbondata.incubator.apache.org Reply-To: issues@carbondata.incubator.apache.org References: In-Reply-To: Subject: [GitHub] incubator-carbondata pull request #620: [CARBONDATA-742] Added batch sort to... Content-Type: text/plain Message-Id: <20170314070802.DC91EDFE1E@git1-us-west.apache.org> Date: Tue, 14 Mar 2017 07:08:02 +0000 (UTC) archived-at: Tue, 14 Mar 2017 07:08:08 -0000 Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/620#discussion_r105838661 --- Diff: core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java --- @@ -1149,6 +1149,19 @@ public static final String USE_KETTLE_DEFAULT = "false"; + /** + * Sorts the data in batches and writes the batch data to store with index file. + */ + public static final String LOAD_USE_BATCH_SORT = "carbon.load.use.batch.sort"; + + public static final String LOAD_USE_BATCH_SORT_DEFAULT = "true"; --- End diff -- Better to make it `false` as of now, and revisit it after checking the performance and loading and reading. And please add comment mentioning something like "if fast loading is favored, set it to true. If fast query performance is favored, set it to false" --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---