spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-21433) Spark SQL should support higher version of Hive metastore
Date Wed, 19 Jul 2017 08:58:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-21433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sean Owen resolved SPARK-21433.
-------------------------------
    Resolution: Invalid

> Spark SQL should support higher version of Hive metastore
> ---------------------------------------------------------
>
>                 Key: SPARK-21433
>                 URL: https://issues.apache.org/jira/browse/SPARK-21433
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.2.0
>         Environment: software platform: Spark 2.2.0, Hive metastore 1.2.1, Hadoop 2.6.5
> operating system: CentOS 6.9
>            Reporter: Gu Chao
>
> Now. Spark SQL supports Hive metastore versions ranging from 0.12.0 to 1.2.1 (inclusive).

> When I start the Thrift JDBC/ODBC server and test with JDBC codes, I will discover that
some running Spark Jobs is very slowly. I want to stop running code to stop this running Spark
Job. But the running code stopped and the running Spark Job does not stop. The system resource
can not be released. 
> Is running spark jobs stopped when a query is cancelled? I think yes.
> I checked same Hive issues and Hive will resolve this issue.
> This is My test code:
> {code:java}
> object App_2017071100 {
>   private[this] val DRIER = "org.apache.hive.jdbc.HiveDriver"
>   private[this] val URL = "jdbc:hive2://192.168.50.3:10000/default"
>   private[this] val USERNAME = "hive"
>   private[this] val PASSWORD = "hive"
>   def main(args: Array[String]): Unit = {
>     var connect: Connection = null
>     var statement: PreparedStatement = null
>     var result: ResultSet = null
>     try {
>       Class.forName(DRIER)
>       connect = DriverManager.getConnection(URL, USERNAME, PASSWORD)
>       statement = connect.prepareStatement("select count(1) from ip")
>       //  statement.setQueryTimeout(30)
>       result = statement.executeQuery
>       while (result.next) {
>         println(result.getString(1))
>       }
>     } catch {
>       case e: LinkageError => e.printStackTrace
>       case e: ExceptionInInitializerError => e.printStackTrace
>       case e: ClassNotFoundException => e.printStackTrace
>       case e: SQLException => e.printStackTrace
>       case e: SQLTimeoutException => e.printStackTrace
>     } finally {
>       if (result != null) result.close
>       if (statement != null) statement.close
>       if (connect != null) connect.close
>     }
>   }
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message