Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6E5F0200C4D for ; Wed, 5 Apr 2017 12:03:34 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 6D11D160B94; Wed, 5 Apr 2017 10:03:34 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A2A29160B91 for ; Wed, 5 Apr 2017 12:03:33 +0200 (CEST) Received: (qmail 95960 invoked by uid 500); 5 Apr 2017 10:03:32 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 95951 invoked by uid 99); 5 Apr 2017 10:03:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Apr 2017 10:03:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 745B81813A9 for ; Wed, 5 Apr 2017 10:03:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.02 X-Spam-Level: X-Spam-Status: No, score=-4.02 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id cYV_lw3vbtIZ for ; Wed, 5 Apr 2017 10:03:31 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id B52A35F24E for ; Wed, 5 Apr 2017 10:03:30 +0000 (UTC) Received: (qmail 95946 invoked by uid 99); 5 Apr 2017 10:03:29 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Apr 2017 10:03:29 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id CC377DFC8E; Wed, 5 Apr 2017 10:03:29 +0000 (UTC) From: mayunSaicmotor To: issues@carbondata.incubator.apache.org Reply-To: issues@carbondata.incubator.apache.org Message-ID: Subject: [GitHub] incubator-carbondata pull request #732: [CARBONDATA-754] improve performance... Content-Type: text/plain Date: Wed, 5 Apr 2017 10:03:29 +0000 (UTC) archived-at: Wed, 05 Apr 2017 10:03:34 -0000 GitHub user mayunSaicmotor opened a pull request: https://github.com/apache/incubator-carbondata/pull/732 [CARBONDATA-754] improve performance when order by prefix columns of mdk + limit the improvement scenario is for order by prefix columns of mdk + limit the logical is to leverage the mdk sort feature to get the sorted data. The performance is much better. for example, order by prefix columns of mdk + limit on 20,000,000 data, the performance can be from 10s to about 1s. if do not want to use this feature, can also set CarbonCommonConstants.ORDER_BY_MDK_OPTIMIZATION_FLG = false. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mayunSaicmotor/incubator-carbondata orderby-mdk Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/732.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #732 ---- ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---