hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chengxiang li" <>
Subject Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]
Date Wed, 21 Jan 2015 07:28:11 GMT

This is an automatically generated e-mail. To reply, visit:

Review request for hive and Xuefu Zhang.

Bugs: HIVE-9410

Repository: hive-git


The RemoteDriver does not contains added jar in it's classpath, so it would failed to desrialize
SparkWork due to NoClassFoundException. For Hive on MR, while use add jar through Hive CLI,
Hive add jar into CLI classpath(through thread context classloader) and add it to distributed
cache as well. Compare to Hive on MR, Hive on Spark has an extra RemoteDriver componnet, we
should add added jar into it's classpath as well.


  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ 044f189 
  spark-client/src/main/java/org/apache/hive/spark/client/ 00aa4ec 
  spark-client/src/main/java/org/apache/hive/spark/client/ 1eb3ff2 
  spark-client/src/main/java/org/apache/hive/spark/client/ 851e937 
  spark-client/src/main/java/org/apache/hive/spark/client/ PRE-CREATION




chengxiang li

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message