Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E371C200BAB for ; Sat, 8 Oct 2016 03:58:09 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id E1F45160AE9; Sat, 8 Oct 2016 01:58:09 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 29FF7160AE8 for ; Sat, 8 Oct 2016 03:58:09 +0200 (CEST) Received: (qmail 52707 invoked by uid 500); 8 Oct 2016 01:58:08 -0000 Mailing-List: contact reviews-help@impala.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@impala.incubator.apache.org Received: (qmail 52692 invoked by uid 99); 8 Oct 2016 01:58:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 08 Oct 2016 01:58:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 8CEF11804B5 for ; Sat, 8 Oct 2016 01:58:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.362 X-Spam-Level: X-Spam-Status: No, score=0.362 tagged_above=-999 required=6.31 tests=[RDNS_DYNAMIC=0.363, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id NLDiS-4yg5VO for ; Sat, 8 Oct 2016 01:58:05 +0000 (UTC) Received: from ip-10-146-233-104.ec2.internal (ec2-75-101-130-251.compute-1.amazonaws.com [75.101.130.251]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 41DBD5FC52 for ; Sat, 8 Oct 2016 01:58:05 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by ip-10-146-233-104.ec2.internal (8.14.4/8.14.4) with ESMTP id u981w4uS021604; Sat, 8 Oct 2016 01:58:04 GMT Message-Id: <201610080158.u981w4uS021604@ip-10-146-233-104.ec2.internal> Date: Sat, 8 Oct 2016 01:58:04 +0000 From: "Michael Ho (Code Review)" To: impala-cr@cloudera.com, reviews@impala.incubator.apache.org CC: Tim Armstrong Reply-To: kwho@cloudera.com X-Gerrit-MessageType: comment Subject: =?UTF-8?Q?=5BImpala-ASF-CR=5D_IMPALA-4080=2C_IMPALA-3638=3A_Introduce_ExecNode=3A=3ACodegen=28=29=0A?= X-Gerrit-Change-Id: I207566bc9f4c6a159271ecdbc4bbdba3d78c6651 X-Gerrit-ChangeURL: X-Gerrit-Commit: 69729917423bafc58ab3b7cf15483bf8e7a09f5b In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.12.2 archived-at: Sat, 08 Oct 2016 01:58:10 -0000 Michael Ho has posted comments on this change. Change subject: IMPALA-4080, IMPALA-3638: Introduce ExecNode::Codegen() ...................................................................... Patch Set 1: (3 comments) FWIW, this patch probably needs to wait for https://gerrit.cloudera.org/#/c/4402. One problem noticed is that the coordinator will now start remote fragments later due to the time to create codegen module. With the aforementioned patch Henry is working on, the root fragment will be started asynchronously together with remote fragments so the bottleneck will be gone. Will address other comments in the upcoming patch. http://gerrit.cloudera.org:8080/#/c/4651/1/be/src/exec/aggregation-node.cc File be/src/exec/aggregation-node.cc: Line 174: if (state->codegen_enabled()) { > I don't think we need to add more functions than the current solution: we n Please let me know if the approach in the new patch is okay with you. http://gerrit.cloudera.org:8080/#/c/4651/1/be/src/exec/old-hash-table.cc File be/src/exec/old-hash-table.cc: Line 419: LlvmCodeGen* codegen = state->codegen(); > Maybe it would make more sense to have the codegen'd exprs owned by the Llv Certainly, the codegen'ed IR function may make sense to be owned by the codegen object. However, it seems odd to have to poke the codegen object to get the type of an expression when codegen is disabled. I will see how the changes to Expr goes before deciding on it. http://gerrit.cloudera.org:8080/#/c/4651/2/testdata/workloads/functional-query/queries/QueryTest/udf-errors.test File testdata/workloads/functional-query/queries/QueryTest/udf-errors.test: Line 28: ---- CATCH > Can we just add the set disable_codegen=1 flag before each of these queries I tried. Unfortunately, the test vector seems to override things. I can add a set statement here but it'll be a no-op. -- To view, visit http://gerrit.cloudera.org:8080/4651 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I207566bc9f4c6a159271ecdbc4bbdba3d78c6651 Gerrit-PatchSet: 1 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Michael Ho Gerrit-Reviewer: Michael Ho Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: Yes