Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2E618200C7D for ; Mon, 17 Apr 2017 05:19:46 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2D18F160BB0; Mon, 17 Apr 2017 03:19:46 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7C7CE160B9D for ; Mon, 17 Apr 2017 05:19:45 +0200 (CEST) Received: (qmail 67331 invoked by uid 500); 17 Apr 2017 03:19:44 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 67318 invoked by uid 99); 17 Apr 2017 03:19:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Apr 2017 03:19:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 328231A0286 for ; Mon, 17 Apr 2017 03:19:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id ryi56DJ1zWnS for ; Mon, 17 Apr 2017 03:19:43 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id E1A765F3FF for ; Mon, 17 Apr 2017 03:19:42 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 3E68BE06BB for ; Mon, 17 Apr 2017 03:19:42 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id C5A6921B47 for ; Mon, 17 Apr 2017 03:19:41 +0000 (UTC) Date: Mon, 17 Apr 2017 03:19:41 +0000 (UTC) From: "Rui Li (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-15302) Relax the requirement that HoS needs Spark built w/o Hive MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 17 Apr 2017 03:19:46 -0000 [ https://issues.apache.org/jira/browse/HIVE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15970629#comment-15970629 ] Rui Li commented on HIVE-15302: ------------------------------- Hi [~vanzin], the goal here is just to figure out what to set for spark.yarn.archive and recommend it in our wiki, so that we don't have to require the Spark is built w/o Hive. [~xuefuz] do you think the min set of jars makes sense? It avoids conflicts and improve performance as much as possible, but shortcoming is the set may change as Spark upgrades. Alternatively, we can simply tell user to use all the jars except those related to Hive. > Relax the requirement that HoS needs Spark built w/o Hive > --------------------------------------------------------- > > Key: HIVE-15302 > URL: https://issues.apache.org/jira/browse/HIVE-15302 > Project: Hive > Issue Type: Improvement > Reporter: Rui Li > Assignee: Rui Li > > This requirement becomes more and more unacceptable as SparkSQL becomes widely adopted. Let's use this JIRA to find out how we can relax the limitation. -- This message was sent by Atlassian JIRA (v6.3.15#6346)