Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 7F392200D19 for ; Fri, 6 Oct 2017 20:25:05 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7D7531609E1; Fri, 6 Oct 2017 18:25:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C2FBF160BDB for ; Fri, 6 Oct 2017 20:25:04 +0200 (CEST) Received: (qmail 73751 invoked by uid 500); 6 Oct 2017 18:25:04 -0000 Mailing-List: contact reviews-help@impala.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@impala.incubator.apache.org Received: (qmail 73730 invoked by uid 99); 6 Oct 2017 18:25:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Oct 2017 18:25:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id E7BA3180940 for ; Fri, 6 Oct 2017 18:25:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.362 X-Spam-Level: ** X-Spam-Status: No, score=2.362 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RDNS_DYNAMIC=0.363, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 2EYM1ZT2ISLx for ; Fri, 6 Oct 2017 18:25:01 +0000 (UTC) Received: from ip-10-146-233-104.ec2.internal (ec2-75-101-130-251.compute-1.amazonaws.com [75.101.130.251]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 51E175FB2F for ; Fri, 6 Oct 2017 18:25:01 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by ip-10-146-233-104.ec2.internal (8.14.4/8.14.4) with ESMTP id v96IOwaD028346; Fri, 6 Oct 2017 18:24:59 GMT Message-Id: <201710061824.v96IOwaD028346@ip-10-146-233-104.ec2.internal> X-Gerrit-PatchSet: 1 Date: Fri, 6 Oct 2017 18:24:58 +0000 From: "Thomas Tauber-Marshall (Code Review)" To: Tianyi Wang , impala-cr@cloudera.com, reviews@impala.incubator.apache.org X-Gerrit-MessageType: comment Subject: =?UTF-8?Q?=5BImpala-ASF-CR=5D_IMPALA-2758=3A_Change_BufferedTupleStream=3A=3AGetRows_to_returning_multi_batches=0A?= X-Gerrit-Change-Id: I3831c38994da2b69775a9809ff01de5d23584414 X-Gerrit-Change-Number: 8226 X-Gerrit-ChangeURL: X-Gerrit-Commit: 8e743671d7afb5888689619ff8beb77446abe109 In-Reply-To: References: X-Gerrit-Comment-Date: Fri, 6 Oct 2017 18:24:58 +0000 Reply-To: tmarshall@cloudera.com, impala-cr@cloudera.com, twang@cloudera.com, marcelk@gmail.com, reviews@impala.incubator.apache.org MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.14.2 Content-Type: multipart/alternative; boundary="XaYtyG98YBk="; charset=UTF-8 archived-at: Fri, 06 Oct 2017 18:25:05 -0000 --XaYtyG98YBk= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thomas Tauber-Marshall has posted comments on this change=2E ( http://gerri= t=2Ecloudera=2Eorg:8080/8226 ) Change subject: IMPALA-2758: Change Buffere= dTupleStream::GetRows to returning multi batches =2E=2E=2E=2E=2E=2E=2E=2E= =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E= =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E= =2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E=2E Patch Set 1: (3 comments) http://g= errit=2Ecloudera=2Eorg:8080/#/c/8226/1//COMMIT_MSG Commit Message: http://= gerrit=2Ecloudera=2Eorg:8080/#/c/8226/1//COMMIT_MSG@14 PS1, Line 14: Any t= esting? http://gerrit=2Ecloudera=2Eorg:8080/#/c/8226/1/be/src/exec/partit= ioned-hash-join-node=2Ecc File be/src/exec/partitioned-hash-join-node=2Ecc:= http://gerrit=2Ecloudera=2Eorg:8080/#/c/8226/1/be/src/exec/partitioned-ha= sh-join-node=2Ecc@950 PS1, Line 950: break; I think this changes the behavi= or here - this will only break out of the FOREACH_ROW loop, but what we wan= t is to stop iterating over the entire set of build rows (that was previous= ly one batch, but is now the same set of rows split into multiple batches)= =2E http://gerrit=2Ecloudera=2Eorg:8080/#/c/8226/1/be/src/runtime/buffere= d-tuple-stream=2Eh File be/src/runtime/buffered-tuple-stream=2Eh: http://g= errit=2Ecloudera=2Eorg:8080/#/c/8226/1/be/src/runtime/buffered-tuple-stream= =2Eh@339 PS1, Line 339: vector>* batch Can you mo= ve this to be after 'batch_size'? We generally keep out parameters as the t= railing parameters for clarity=2E -- To view, visit http://gerrit=2Eclo= udera=2Eorg:8080/8226 To unsubscribe, visit http://gerrit=2Ecloudera=2Eorg:= 8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Mess= ageType: comment Gerrit-Change-Id: I3831c38994da2b69775a9809ff01de5d2358441= 4 Gerrit-Change-Number: 8226 Gerrit-PatchSet: 1 Gerrit-Owner: Tianyi Wang <= twang@cloudera=2Ecom> Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Fri, 06 Oct 2017 18:24:58 +0000 Gerrit-H= asComments: Yes --XaYtyG98YBk=--