Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A7E94200C3B for ; Sat, 18 Mar 2017 16:20:13 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id A6819160B7F; Sat, 18 Mar 2017 15:20:13 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id EF4A3160B71 for ; Sat, 18 Mar 2017 16:20:12 +0100 (CET) Received: (qmail 46458 invoked by uid 500); 18 Mar 2017 15:20:12 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 46449 invoked by uid 99); 18 Mar 2017 15:20:12 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Mar 2017 15:20:12 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id CC222C059C for ; Sat, 18 Mar 2017 15:20:11 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.02 X-Spam-Level: X-Spam-Status: No, score=-4.02 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id V8AF47BkfIW7 for ; Sat, 18 Mar 2017 15:20:11 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 3F0E05FAD8 for ; Sat, 18 Mar 2017 15:20:10 +0000 (UTC) Received: (qmail 46440 invoked by uid 99); 18 Mar 2017 15:20:09 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Mar 2017 15:20:09 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 42FC3DFF75; Sat, 18 Mar 2017 15:20:09 +0000 (UTC) From: sounakr To: issues@carbondata.incubator.apache.org Reply-To: issues@carbondata.incubator.apache.org Message-ID: Subject: [GitHub] incubator-carbondata pull request #670: [CARBONDATA-792] Range Filter Optimi... Content-Type: text/plain Date: Sat, 18 Mar 2017 15:20:09 +0000 (UTC) archived-at: Sat, 18 Mar 2017 15:20:13 -0000 GitHub user sounakr opened a pull request: https://github.com/apache/incubator-carbondata/pull/670 [CARBONDATA-792] Range Filter Optimization Problem : LessThan and GreaterThan Expression are merged into a single RANGE expression. Analysis : If LessThan and GreaterThan Expression on a same column given as filter predicates, then each expression is evaluated independently and finally AND operator is applied on individual results to get the final output. Fix : If the LessThan and GreaterThan Expression values can form a Range then it is Converted into a RANGE expression and results are evaluated through single expression. I.e. if the value lies within Range then choosen. This fix will optimize Block Prunning and Reduce Scanning time in case queries have range expressions in filter. You can merge this pull request into a Git repository by running: $ git pull https://github.com/sounakr/incubator-carbondata range1 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/670.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #670 ---- commit e77cc5a84e9d6313383cb6347f78846f3319442e Author: sounakr Date: 2017-03-15T16:06:16Z [CARBONDATA-792] Range Filter Optimization ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---