hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Furcy Pin <furcy....@flaminem.com>
Subject Re: UDTF "KryoException: unable create/find class" error in hive 0.13
Date Tue, 09 Sep 2014 08:31:54 GMT
Hi,

I think I encountered this kind of serialization problem when writing UDFs.
Usually, marking every fields of the UDF as *transient* does the trick.

I guess the error means that Kryo tries to serialize the UDF class and
everything that is inside, and by marking them as transient
you ensure that it will not and that they will be instantiated in the
default constructor or during the call of initialize()

Please keep me informed if it works or not,

Regards,

Furcy


2014-09-09 1:44 GMT+02:00 Echo Li <echolql@gmail.com>:

> I wrote a UDTF in hive 0.13, the function parse a column which is json
> string and return a table. The function compiles successfully by adding
> hive-exec-0.13.0.2.1.2.1-471.jar to classpath, however when the jar is
> added to hive and a function created using the jar then I try to run a
> query using that function, I got error:
>
> org.apache.hive.com.esotericsoftware.kryo.KryoException: Unable to find
> class: class_name
>
> I went through all steps in a lower version hive (0.10) everything works
> fine, I searched around and seams that is caused by the ‘kryo” serde, so my
> question is, is there a fix? and where to find it?
>
> thank you.
>

Mime
View raw message