From dev-return-24447-archive-asf-public=cust-asf.ponee.io@spark.apache.org Thu Apr 12 16:49:01 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id D68C3180634 for ; Thu, 12 Apr 2018 16:49:00 +0200 (CEST) Received: (qmail 17546 invoked by uid 500); 12 Apr 2018 14:48:59 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 17528 invoked by uid 99); 12 Apr 2018 14:48:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Apr 2018 14:48:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id EF54B18038B for ; Thu, 12 Apr 2018 14:48:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.485 X-Spam-Level: *** X-Spam-Status: No, score=3.485 tagged_above=-999 required=6.31 tests=[DKIM_ADSP_CUSTOM_MED=0.001, NML_ADSP_CUSTOM_MED=1.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_PASS=-0.001, SPF_SOFTFAIL=0.972, URI_HEX=1.313] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id NGG1ArbA2-BU for ; Thu, 12 Apr 2018 14:48:57 +0000 (UTC) Received: from n3.nabble.com (n3.nabble.com [162.255.23.22]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id ECB655F397 for ; Thu, 12 Apr 2018 14:48:56 +0000 (UTC) Received: from n3.nabble.com (localhost [127.0.0.1]) by n3.nabble.com (Postfix) with ESMTP id 39DD3C44C88A for ; Thu, 12 Apr 2018 07:48:55 -0700 (MST) Date: Thu, 12 Apr 2018 07:48:55 -0700 (MST) From: Liang-Chi Hsieh To: dev@spark.apache.org Message-ID: <1523544535234-0.post@n3.nabble.com> In-Reply-To: References: Subject: Re: Accessing Hive Tables in Spark MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Seems like Spark can't access hive-site.xml under cluster mode. One solution is to add the config `spark.yarn.dist.files=/path/to/hive-site.xml` to your spark-defaults.conf. And don't forget to call `enableHiveSupport()` on `SparkSession`. Tushar Singhal wrote > Hi Everyone, > > I was accessing Hive Tables in Spark SQL using Scala submitted by > spark-submit command. > When I ran in cluster mode then got error like : Table not found > But the same is working while submitted as client mode. > Please help me to understand why? > > Distribution : Hortonworks > > Thanks in advance !! -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscribe@spark.apache.org