From issues-return-18318-archive-asf-public=cust-asf.ponee.io@hawq.incubator.apache.org Sat Apr 28 09:57:07 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 792AC180649 for ; Sat, 28 Apr 2018 09:57:06 +0200 (CEST) Received: (qmail 19892 invoked by uid 500); 28 Apr 2018 07:57:05 -0000 Mailing-List: contact issues-help@hawq.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hawq.incubator.apache.org Delivered-To: mailing list issues@hawq.incubator.apache.org Received: (qmail 19883 invoked by uid 99); 28 Apr 2018 07:57:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 28 Apr 2018 07:57:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id AD1BAC00D5 for ; Sat, 28 Apr 2018 07:57:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.21 X-Spam-Level: X-Spam-Status: No, score=-3.21 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id dqgfEDgPN7kN for ; Sat, 28 Apr 2018 07:57:01 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id 7E0CD5FB95 for ; Sat, 28 Apr 2018 07:57:00 +0000 (UTC) Received: (qmail 19614 invoked by uid 99); 28 Apr 2018 07:56:59 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 28 Apr 2018 07:56:59 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id B7621E965C; Sat, 28 Apr 2018 07:56:59 +0000 (UTC) From: weinan003 To: issues@hawq.incubator.apache.org Reply-To: issues@hawq.incubator.apache.org References: In-Reply-To: Subject: [GitHub] incubator-hawq pull request #1358: HAWQ-1609. Implement Vectorized Motion No... Content-Type: text/plain Message-Id: <20180428075659.B7621E965C@git1-us-west.apache.org> Date: Sat, 28 Apr 2018 07:56:59 +0000 (UTC) Github user weinan003 commented on a diff in the pull request: https://github.com/apache/incubator-hawq/pull/1358#discussion_r184844441 --- Diff: contrib/vexecutor/nodeVMotion.c --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +#include "nodeVMotion.h" +#include "tuplebatch.h" +#include "execVQual.h" +/*========================================================================= + * FUNCTIONS PROTOTYPES + */ +static TupleTableSlot *execVMotionSender(MotionState * node); +static TupleTableSlot *execVMotionUnsortedReceiver(MotionState * node); + +TupleTableSlot *ExecVMotion(MotionState * node); +static void doSendTupleBatch(Motion * motion, MotionState * node, TupleTableSlot *outerTupleSlot); +static SendReturnCode +SendTupleBatch(MotionLayerState *mlStates, ChunkTransportState *transportStates, + int16 motNodeID, TupleBatch tuplebatch, int16 targetRoute); +/*========================================================================= + */ + +TupleTableSlot * +ExecVMotionVirtualLayer(MotionState *node) +{ + if(node->mstype == MOTIONSTATE_SEND) + return ExecVMotion(node); + else if(node->mstype == MOTIONSTATE_RECV) + { + TupleTableSlot* slot = node->ps.ps_ResultTupleSlot; + while(1) + { + bool succ = VirtualNodeProc(slot); + if(!succ) + { + slot = ExecVMotion(node); + if(TupIsNull(slot)) + break; + else + continue; + } + + break; + } + return slot; + } +} + +/* ---------------------------------------------------------------- + * ExecVMotion + * ---------------------------------------------------------------- + */ +TupleTableSlot * +ExecVMotion(MotionState * node) +{ + Motion *motion = (Motion *) node->ps.plan; + + /* + * at the top here we basically decide: -- SENDER vs. RECEIVER and -- + * SORTED vs. UNSORTED + */ + if (node->mstype == MOTIONSTATE_RECV) + { + TupleTableSlot *tuple; + + if (node->ps.state->active_recv_id >= 0) + { + if (node->ps.state->active_recv_id != motion->motionID) + { + elog(LOG, "DEADLOCK HAZARD: Updating active_motion_id from %d to %d", + node->ps.state->active_recv_id, motion->motionID); + node->ps.state->active_recv_id = motion->motionID; + } + } else + node->ps.state->active_recv_id = motion->motionID; + + /* Running in diagnostic mode ? */ + if (Gp_interconnect_type == INTERCONNECT_TYPE_NIL) + { + node->ps.state->active_recv_id = -1; + return NULL; + } + + Assert(!motion->sendSorted); + + tuple = execVMotionUnsortedReceiver(node); + + if (tuple == NULL) + node->ps.state->active_recv_id = -1; + else + { + Gpmon_M_Incr(GpmonPktFromMotionState(node), GPMON_QEXEC_M_ROWSIN); --- End diff -- Gpmon in VE model records tuplebatch instead of per tuple ---