Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 339BE200D37 for ; Thu, 9 Nov 2017 19:53:48 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 321BE160BEF; Thu, 9 Nov 2017 18:53:48 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 510341609C8 for ; Thu, 9 Nov 2017 19:53:47 +0100 (CET) Received: (qmail 34752 invoked by uid 500); 9 Nov 2017 18:53:46 -0000 Mailing-List: contact reviews-help@impala.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@impala.incubator.apache.org Received: (qmail 34741 invoked by uid 99); 9 Nov 2017 18:53:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Nov 2017 18:53:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 785481A3E21 for ; Thu, 9 Nov 2017 18:53:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.363 X-Spam-Level: ** X-Spam-Status: No, score=2.363 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RDNS_DYNAMIC=0.363, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id bHEe360E2qmE for ; Thu, 9 Nov 2017 18:53:43 +0000 (UTC) Received: from ip-10-146-233-104.ec2.internal (ec2-75-101-130-251.compute-1.amazonaws.com [75.101.130.251]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 0CB3561563 for ; Thu, 9 Nov 2017 18:53:42 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by ip-10-146-233-104.ec2.internal (8.14.4/8.14.4) with ESMTP id vA9Irepb007166; Thu, 9 Nov 2017 18:53:40 GMT Message-Id: <201711091853.vA9Irepb007166@ip-10-146-233-104.ec2.internal> X-Gerrit-PatchSet: 14 Date: Thu, 9 Nov 2017 18:53:40 +0000 From: "Thomas Tauber-Marshall (Code Review)" To: impala-cr@cloudera.com, reviews@impala.incubator.apache.org CC: Matthew Jacobs , Michael Ho , Mostafa Mokhtar , Lars Volker , Tim Armstrong , Todd Lipcon , Alex Behm , Dan Hecht X-Gerrit-MessageType: comment Subject: =?UTF-8?Q?=5BImpala-ASF-CR=5D_IMPALA-4252=3A_Min-max_runtime_filters_for_Kudu=0A?= X-Gerrit-Change-Id: I02bad890f5b5f78388a3041bf38f89369b5e2f1c X-Gerrit-Change-Number: 7793 X-Gerrit-ChangeURL: X-Gerrit-Commit: d3dbe228a36a8d67f9c2bcd4e510b618f33fa12f In-Reply-To: References: X-Gerrit-Comment-Date: Thu, 9 Nov 2017 18:53:40 +0000 Reply-To: tmarshall@cloudera.com, impala-cr@cloudera.com, lv@cloudera.com, marcelk@gmail.com, kwho@cloudera.com, tarmstrong@cloudera.com, dhecht@cloudera.com, mmokhtar@cloudera.com, todd@apache.org, alex.behm@cloudera.com, reviews@impala.incubator.apache.org, mjacobs@apache.org MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.14.2 Content-Type: multipart/alternative; boundary="VyCRIkwwQB0="; charset=UTF-8 archived-at: Thu, 09 Nov 2017 18:53:48 -0000 --VyCRIkwwQB0= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thomas Tauber-Marshall has posted comments on this change=2E ( http://gerri= t=2Ecloudera=2Eorg:8080/7793 ) Change subject: IMPALA-4252: Min-max runtim= e filters for Kudu =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E= =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E= =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E= =2E=2E Patch Set 14: (7 comments) http://gerrit=2Ecloudera=2Eorg:8080/#= /c/7793/13/be/src/exec/kudu-scanner=2Ecc File be/src/exec/kudu-scanner=2Ecc= : http://gerrit=2Ecloudera=2Eorg:8080/#/c/7793/13/be/src/exec/kudu-scanner= =2Ecc@200 PS13, Line 200: if (!filter->GetCastIntMinMax(col_typ= e, &int_min, &int_max)) { > Unfortunate that that every Kudu client has to = do this=2E This is something that's been discussed before (see KUDU-931), I= 'm not sure why they decided not to do it=2E http://gerrit=2Ecloudera=2Eo= rg:8080/#/c/7793/13/be/src/util/min-max-filter=2Ecc File be/src/util/min-ma= x-filter=2Ecc: http://gerrit=2Ecloudera=2Eorg:8080/#/c/7793/13/be/src/util= /min-max-filter=2Ecc@139 PS13, Line 139: case TYPE_BIGINT: > using std:= :numeric_limits; at the top if this file Done http://gerrit=2Ecloudera=2E= org:8080/#/c/7793/13/be/src/util/min-max-filter=2Ecc@165 PS13, Line 165: >= Brief comment especially about the return value would be good=2E Done ht= tp://gerrit=2Ecloudera=2Eorg:8080/#/c/7793/13/fe/src/main/java/org/apache/i= mpala/planner/RuntimeFilterGenerator=2Ejava File fe/src/main/java/org/apach= e/impala/planner/RuntimeFilterGenerator=2Ejava: http://gerrit=2Ecloudera= =2Eorg:8080/#/c/7793/13/fe/src/main/java/org/apache/impala/planner/RuntimeF= ilterGenerator=2Ejava@604 PS13, Line 604: // must be a SlotRef poin= ting to a column=2E We can allow implicit integer casts > typo: We can allo= w implicit integer casts Done http://gerrit=2Ecloudera=2Eorg:8080/#/c/779= 3/13/fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator=2Eja= va@605 PS13, Line 605: // by casting the min/max values before send= ing them to Kudu=2E > min/max values Done http://gerrit=2Ecloudera=2Eorg:= 8080/#/c/7793/13/testdata/workloads/functional-query/queries/QueryTest/min_= max_filters=2Etest File testdata/workloads/functional-query/queries/QueryTe= st/min_max_filters=2Etest: http://gerrit=2Ecloudera=2Eorg:8080/#/c/7793/13= /testdata/workloads/functional-query/queries/QueryTest/min_max_filters=2Ete= st@98 PS13, Line 98: where a=2Etinyint_col =3D b=2Eint_col and b=2Eint_col = in (0, 1) > Let's make the min/max filter selective, e=2Eg=2E by adding whe= re b=2Eint_col in Done http://gerrit=2Ecloudera=2Eorg:8080/#/c/7793/13/t= estdata/workloads/functional-query/queries/QueryTest/min_max_filters=2Etest= @103 PS13, Line 103: # The min/max values in the filter are both above the = range of the target col so all rows > Let's also add a non-selective case w= here the min/max values fall outside t Done -- To view, visit http://ge= rrit=2Ecloudera=2Eorg:8080/7793 To unsubscribe, visit http://gerrit=2Ecloud= era=2Eorg:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master G= errit-MessageType: comment Gerrit-Change-Id: I02bad890f5b5f78388a3041bf38f8= 9369b5e2f1c Gerrit-Change-Number: 7793 Gerrit-PatchSet: 14 Gerrit-Owner: Th= omas Tauber-Marshall Gerrit-Reviewer: Alex Behm = Gerrit-Reviewer: Anonymous Coward #345 Gerrit-= Reviewer: Dan Hecht Gerrit-Reviewer: Lars Volker Gerrit-Reviewer: Matthew Jacobs Ge= rrit-Reviewer: Michael Ho Gerrit-Reviewer: Mostafa Mo= khtar Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Todd Lipcon Gerrit-Comment-Dat= e: Thu, 09 Nov 2017 18:53:40 +0000 Gerrit-HasComments: Yes --VyCRIkwwQB0=--