hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Commented] (HIVE-5405) Need to implement PersistenceDelegate for org.antlr.runtime.CommonToken
Date Tue, 01 Oct 2013 18:27:28 GMT


Brock Noland commented on HIVE-5405:

RIght, in HIVE-5263 we didn't perform this update so hive.plan.serialization.format=javaXML
won't actually work.  One more question, I am just curious as to why you are setting hive.plan.serialization.format
to javaXML? It's useful in our tests but in general it should be a unperformant configuration

> Need to implement PersistenceDelegate for org.antlr.runtime.CommonToken
> -----------------------------------------------------------------------
>                 Key: HIVE-5405
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.12.0
>            Reporter: shanyu zhao
>            Assignee: shanyu zhao
>         Attachments: HIVE-5405.patch
> Prior to HIVE-1511, running hive join operation results in the following exception:
> java.lang.RuntimeException: Cannot serialize object
>         at org.apache.hadoop.hive.ql.exec.Utilities$1.exceptionThrown(Utilities.
> java:639)
>         at java.beans.XMLEncoder.writeStatement(
> ...
> Caused by: java.lang.InstantiationException: org.antlr.runtime.CommonToken
>         at java.lang.Class.newInstance0(
>         at java.lang.Class.newInstance(
>         at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> HIVE-1511 introduced a new (and set to default) hive plan serialization format Kryo,
which fixed this problem by implementing the Kryo serializer for CommonToken. However, if
we set the following in configuration file:
> <property>
> <name>hive.plan.serialization.format</name>
> <value>javaXML</value>
> </property>
> We'll see the same failure as before. We need to implement a PersistenceDelegate for
the situation when "javaXML" is set to serialization format.

This message was sent by Atlassian JIRA

View raw message