hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5405) Need to implement PersistenceDelegate for org.antlr.runtime.CommonToken
Date Wed, 02 Oct 2013 21:22:42 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784449#comment-13784449
] 

Thejas M Nair commented on HIVE-5405:
-------------------------------------

Sorry, that patch does not work with 0.12 . Looks like CommonToken is not used in 0.12 . 
Do we need this patch for 0.12 ?

{code}
compile:
     [echo] Project: ql
    [javac] Compiling 922 source files to /home/hortonth/hive_apache/build/ql/classes
    [javac] /home/hortonth/hive_apache/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java:464:
cannot find symbol
    [javac] symbol  : class CommonToken
    [javac] location: class org.apache.hadoop.hive.ql.exec.Utilities.CommonTokenDelegate
    [javac]       CommonToken ct = (CommonToken)oldInstance;
    [javac]       ^
    [javac] /home/hortonth/hive_apache/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java:464:
cannot find symbol
    [javac] symbol  : class CommonToken
    [javac] location: class org.apache.hadoop.hive.ql.exec.Utilities.CommonTokenDelegate
    [javac]       CommonToken ct = (CommonToken)oldInstance;
    [javac]                         ^
    [javac] /home/hortonth/hive_apache/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java:466:
internal error; cannot instantiate java.beans.Expression.<init> at java.beans.Expression
to ()
    [javac]       return new Expression(ct, ct.getClass(), "new", args);
    [javac]              ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 3 errors

{code}

> Need to implement PersistenceDelegate for org.antlr.runtime.CommonToken
> -----------------------------------------------------------------------
>
>                 Key: HIVE-5405
>                 URL: https://issues.apache.org/jira/browse/HIVE-5405
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.12.0
>            Reporter: shanyu zhao
>            Assignee: shanyu zhao
>             Fix For: 0.13.0
>
>         Attachments: HIVE-5405-branch-0.12.patch, HIVE-5405.patch
>
>
> Prior to HIVE-1511, running hive join operation results in the following exception:
> java.lang.RuntimeException: Cannot serialize object
>         at org.apache.hadoop.hive.ql.exec.Utilities$1.exceptionThrown(Utilities.
> java:639)
>         at java.beans.XMLEncoder.writeStatement(XMLEncoder.java:426)
> ...
> Caused by: java.lang.InstantiationException: org.antlr.runtime.CommonToken
>         at java.lang.Class.newInstance0(Class.java:357)
>         at java.lang.Class.newInstance(Class.java:325)
>         at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:43)
> HIVE-1511 introduced a new (and set to default) hive plan serialization format Kryo,
which fixed this problem by implementing the Kryo serializer for CommonToken. However, if
we set the following in configuration file:
> <property>
> <name>hive.plan.serialization.format</name>
> <value>javaXML</value>
> </property>
> We'll see the same failure as before. We need to implement a PersistenceDelegate for
the situation when "javaXML" is set to serialization format.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message