hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <>
Subject [jira] [Created] (HIVE-12880) spark-assembly causes Hive class version problems
Date Fri, 15 Jan 2016 20:28:39 GMT
Sergey Shelukhin created HIVE-12880:

             Summary: spark-assembly causes Hive class version problems
                 Key: HIVE-12880
             Project: Hive
          Issue Type: Bug
            Reporter: Sergey Shelukhin

It looks like spark-assembly contains versions of Hive classes (e.g. HiveConf), and these
sometimes (always?) come from older versions of Hive.
We've seen problems where depending on classpath changes, NoSuchField errors are thrown for
recently added configs because the HiveConf class comes from spark-assembly.

Would making sure spark-assembly comes last in the classpath solve the problem?
Otherwise, can we depend on something that does not package Hive classes?

Currently, HIVE-12179 provides a workaround (in non-Spark use case, at least; I am assuming
this issue can also affect Hive-on-Spark).

This message was sent by Atlassian JIRA

View raw message