Return-Path: <issues-return-145217-archive-asf-public=cust-asf.ponee.io@spark.apache.org>
X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io
Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io
Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183])
	by cust-asf2.ponee.io (Postfix) with ESMTP id 78DF5200C00
	for <archive-asf-public-internal@cust-asf2.ponee.io>; Wed,  4 Jan 2017 06:23:00 +0100 (CET)
Received: by cust-asf.ponee.io (Postfix)
	id 7780A160B43; Wed,  4 Jan 2017 05:23:00 +0000 (UTC)
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by cust-asf.ponee.io (Postfix) with SMTP id C1E94160B46
	for <archive-asf-public@cust-asf.ponee.io>; Wed,  4 Jan 2017 06:22:59 +0100 (CET)
Received: (qmail 73060 invoked by uid 500); 4 Jan 2017 05:22:58 -0000
Mailing-List: contact issues-help@spark.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:issues-help@spark.apache.org>
List-Unsubscribe: <mailto:issues-unsubscribe@spark.apache.org>
List-Post: <mailto:issues@spark.apache.org>
List-Id: <issues.spark.apache.org>
Delivered-To: mailing list issues@spark.apache.org
Received: (qmail 72998 invoked by uid 99); 4 Jan 2017 05:22:58 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Jan 2017 05:22:58 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id AABCF2C1F54
	for <issues@spark.apache.org>; Wed,  4 Jan 2017 05:22:58 +0000 (UTC)
Date: Wed, 4 Jan 2017 05:22:58 +0000 (UTC)
From: "Dapeng Sun (JIRA)" <jira@apache.org>
To: issues@spark.apache.org
Message-ID: <JIRA.12941306.1456211657000.635626.1483507378696@Atlassian.JIRA>
In-Reply-To: <JIRA.12941306.1456211657000@Atlassian.JIRA>
References: <JIRA.12941306.1456211657000@Atlassian.JIRA> <JIRA.12941306.1456211657549@arcas>
Subject: [jira] [Comment Edited] (SPARK-13446) Spark need to support reading
 data from Hive 2.0.0 metastore
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
archived-at: Wed, 04 Jan 2017 05:23:00 -0000


    [ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797215#comment-15797215 ] 

Dapeng Sun edited comment on SPARK-13446 at 1/4/17 5:22 AM:
------------------------------------------------------------

Hi all,

I created SPARK-19076 may be related to this issue, comments or suggestions are welcomed. Thanks!


was (Author: dapengsun):
Hi all,

I created SPARK-19076 may be related to this issue, comments or suggestions are welcome. Thanks!

> Spark need to support reading data from Hive 2.0.0 metastore
> ------------------------------------------------------------
>
>                 Key: SPARK-13446
>                 URL: https://issues.apache.org/jira/browse/SPARK-13446
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 1.6.0
>            Reporter: Lifeng Wang
>
> Spark provided HIveContext class to read data from hive metastore directly. While it only supports hive 1.2.1 version and older. Since hive 2.0.0 has released, it's better to upgrade to support Hive 2.0.0.
> {noformat}
> 16/02/23 02:35:02 INFO metastore: Trying to connect to metastore with URI thrift://hsw-node13:9083
> 16/02/23 02:35:02 INFO metastore: Opened a connection to metastore, current connections: 1
> 16/02/23 02:35:02 INFO metastore: Connected to metastore.
> Exception in thread "main" java.lang.NoSuchFieldError: HIVE_STATS_JDBC_TIMEOUT
>         at org.apache.spark.sql.hive.HiveContext.configure(HiveContext.scala:473)
>         at org.apache.spark.sql.hive.HiveContext.metadataHive$lzycompute(HiveContext.scala:192)
>         at org.apache.spark.sql.hive.HiveContext.metadataHive(HiveContext.scala:185)
>         at org.apache.spark.sql.hive.HiveContext$$anon$1.<init>(HiveContext.scala:422)
>         at org.apache.spark.sql.hive.HiveContext.catalog$lzycompute(HiveContext.scala:422)
>         at org.apache.spark.sql.hive.HiveContext.catalog(HiveContext.scala:421)
>         at org.apache.spark.sql.hive.HiveContext.catalog(HiveContext.scala:72)
>         at org.apache.spark.sql.SQLContext.table(SQLContext.scala:739)
>         at org.apache.spark.sql.SQLContext.table(SQLContext.scala:735)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org