Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E88AC200C86 for ; Wed, 17 May 2017 07:45:47 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id E6E25160BC9; Wed, 17 May 2017 05:45:47 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 12062160BC1 for ; Wed, 17 May 2017 07:45:46 +0200 (CEST) Received: (qmail 8810 invoked by uid 500); 17 May 2017 05:45:46 -0000 Mailing-List: contact commits-help@quickstep.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@quickstep.incubator.apache.org Delivered-To: mailing list commits@quickstep.incubator.apache.org Received: (qmail 8796 invoked by uid 99); 17 May 2017 05:45:45 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 May 2017 05:45:45 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 61DA3C0EA2 for ; Wed, 17 May 2017 05:45:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.222 X-Spam-Level: X-Spam-Status: No, score=-4.222 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id NMZaQWBmvl77 for ; Wed, 17 May 2017 05:45:44 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id B35BD5F1E7 for ; Wed, 17 May 2017 05:45:43 +0000 (UTC) Received: (qmail 8786 invoked by uid 99); 17 May 2017 05:45:43 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 May 2017 05:45:43 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 095BBDFD84; Wed, 17 May 2017 05:45:42 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: zuyuz@apache.org To: commits@quickstep.incubator.apache.org Message-Id: <2614cd1022a341949eb519ff12b343a0@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: incubator-quickstep git commit: Minor refactor scheduler in the distributed version. Date: Wed, 17 May 2017 05:45:42 +0000 (UTC) archived-at: Wed, 17 May 2017 05:45:48 -0000 Repository: incubator-quickstep Updated Branches: refs/heads/master ed72e2477 -> 97650fb85 Minor refactor scheduler in the distributed version. Project: http://git-wip-us.apache.org/repos/asf/incubator-quickstep/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-quickstep/commit/97650fb8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-quickstep/tree/97650fb8 Diff: http://git-wip-us.apache.org/repos/asf/incubator-quickstep/diff/97650fb8 Branch: refs/heads/master Commit: 97650fb85cee9c93aadc37adf6cbcc0f6d61244c Parents: ed72e24 Author: Zuyu Zhang Authored: Tue May 16 21:29:15 2017 -0700 Committer: Zuyu Zhang Committed: Tue May 16 21:29:15 2017 -0700 ---------------------------------------------------------------------- query_execution/PolicyEnforcerDistributed.cpp | 8 ++++---- query_execution/QueryManagerDistributed.cpp | 10 +++------- query_execution/QueryManagerDistributed.hpp | 6 +----- 3 files changed, 8 insertions(+), 16 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-quickstep/blob/97650fb8/query_execution/PolicyEnforcerDistributed.cpp ---------------------------------------------------------------------- diff --git a/query_execution/PolicyEnforcerDistributed.cpp b/query_execution/PolicyEnforcerDistributed.cpp index 36becf2..b410152 100644 --- a/query_execution/PolicyEnforcerDistributed.cpp +++ b/query_execution/PolicyEnforcerDistributed.cpp @@ -112,11 +112,11 @@ void PolicyEnforcerDistributed::getWorkOrderProtoMessages( DCHECK(curr_query_manager != nullptr); std::size_t messages_collected_curr_query = 0; while (messages_collected_curr_query < per_query_share) { - S::WorkOrderMessage *next_work_order_message = - static_cast(curr_query_manager)->getNextWorkOrderMessage(0); - if (next_work_order_message != nullptr) { + unique_ptr next_work_order_message( + static_cast(curr_query_manager)->getNextWorkOrderMessage()); + if (next_work_order_message) { ++messages_collected_curr_query; - work_order_proto_messages->push_back(unique_ptr(next_work_order_message)); + work_order_proto_messages->push_back(move(next_work_order_message)); } else { // No more work ordes from the current query at this time. // Check if the query's execution is over. http://git-wip-us.apache.org/repos/asf/incubator-quickstep/blob/97650fb8/query_execution/QueryManagerDistributed.cpp ---------------------------------------------------------------------- diff --git a/query_execution/QueryManagerDistributed.cpp b/query_execution/QueryManagerDistributed.cpp index 92645b6..b304f9f 100644 --- a/query_execution/QueryManagerDistributed.cpp +++ b/query_execution/QueryManagerDistributed.cpp @@ -79,19 +79,15 @@ QueryManagerDistributed::QueryManagerDistributed(QueryHandle *query_handle, } } -serialization::WorkOrderMessage* QueryManagerDistributed::getNextWorkOrderMessage( - const dag_node_index start_operator_index) { +serialization::WorkOrderMessage* QueryManagerDistributed::getNextWorkOrderMessage() { // Default policy: Operator with lowest index first. - size_t num_operators_checked = 0; - for (dag_node_index index = start_operator_index; - num_operators_checked < num_operators_in_dag_; - index = (index + 1) % num_operators_in_dag_, ++num_operators_checked) { + for (dag_node_index index = 0u; index < num_operators_in_dag_; ++index) { if (query_exec_state_->hasExecutionFinished(index)) { continue; } unique_ptr work_order_proto( normal_workorder_protos_container_->getWorkOrderProto(index)); - if (work_order_proto != nullptr) { + if (work_order_proto) { query_exec_state_->incrementNumQueuedWorkOrders(index); unique_ptr message_proto(new serialization::WorkOrderMessage); http://git-wip-us.apache.org/repos/asf/incubator-quickstep/blob/97650fb8/query_execution/QueryManagerDistributed.hpp ---------------------------------------------------------------------- diff --git a/query_execution/QueryManagerDistributed.hpp b/query_execution/QueryManagerDistributed.hpp index 6a47ce8..ab4479c 100644 --- a/query_execution/QueryManagerDistributed.hpp +++ b/query_execution/QueryManagerDistributed.hpp @@ -91,14 +91,10 @@ class QueryManagerDistributed final : public QueryManagerBase { * @brief Get the next normal workorder to be excuted, wrapped in a * WorkOrderMessage proto. * - * @param start_operator_index Begin the search for the schedulable WorkOrder - * with the operator at this index. - * * @return A pointer to the WorkOrderMessage proto. If there is no WorkOrder * to be executed, return NULL. **/ - serialization::WorkOrderMessage* getNextWorkOrderMessage( - const dag_node_index start_operator_index); + serialization::WorkOrderMessage* getNextWorkOrderMessage(); /** * @brief Get the index of Shiftboss for an Aggregation related WorkOrder. If