Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6F993100EE for ; Wed, 3 Jun 2015 01:29:50 +0000 (UTC) Received: (qmail 84587 invoked by uid 500); 3 Jun 2015 01:29:49 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 84509 invoked by uid 500); 3 Jun 2015 01:29:49 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 84477 invoked by uid 99); 3 Jun 2015 01:29:49 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Jun 2015 01:29:49 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 53A22E0427; Wed, 3 Jun 2015 01:29:49 +0000 (UTC) From: navis To: dev@hive.apache.org Reply-To: dev@hive.apache.org Message-ID: Subject: [GitHub] hive pull request: HIVE-10890 Provide implementable engine selecto... Content-Type: text/plain Date: Wed, 3 Jun 2015 01:29:49 +0000 (UTC) GitHub user navis opened a pull request: https://github.com/apache/hive/pull/41 HIVE-10890 Provide implementable engine selector Now hive supports three kind of engines. It would be good to have an automatic engine selector without setting explicitly engine for execution. Added two configurations > hive.execution.engine.selector > hive.execution.engine.selector.param Test implementation is included as EngineSelector$SimpleSelector, which supports simple grammar something like, > spark = $total < 10gb && $num_aliases < 4, tez which means if total input length is less than 10gb and number of aliases is less than 4, use spark, else tez You can merge this pull request into a Git repository by running: $ git pull https://github.com/navis/hive HIVE-10890 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/41.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #41 ---- commit 9349d121bdd274485c0c0f4d149c5d382bed54e3 Author: navis.ryu Date: 2015-06-03T01:10:51Z HIVE-10890 Provide implementable engine selector ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---