Return-Path: 
 <user-return-19616-apmail-hive-user-archive=hive.apache.org@hive.apache.org>
X-Original-To: apmail-hive-user-archive@www.apache.org
Delivered-To: apmail-hive-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id D299210E6B
	for <apmail-hive-user-archive@www.apache.org>;
 Tue,  5 May 2015 11:30:11 +0000 (UTC)
Received: (qmail 99180 invoked by uid 500); 5 May 2015 11:30:10 -0000
Delivered-To: apmail-hive-user-archive@hive.apache.org
Received: (qmail 99111 invoked by uid 500); 5 May 2015 11:30:09 -0000
Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hive.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hive.apache.org>
List-Post: <mailto:user@hive.apache.org>
List-Id: <user.hive.apache.org>
Reply-To: user@hive.apache.org
Delivered-To: mailing list user@hive.apache.org
Received: (qmail 99101 invoked by uid 99); 5 May 2015 11:30:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 May 2015 11:30:09 +0000
X-ASF-Spam-Status: No, hits=2.4 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: message received from 54.164.171.186
 which is an MX secondary for user@hive.apache.org)
Received: from [54.164.171.186] (HELO mx1-us-east.apache.org) (54.164.171.186)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 May 2015 11:30:04 +0000
Received: from mail-ob0-f181.google.com (mail-ob0-f181.google.com
 [209.85.214.181])
	by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with
 ESMTPS id 6474143E79
	for <user@hive.apache.org>; Tue,  5 May 2015 11:29:44 +0000 (UTC)
Received: by obfe9 with SMTP id e9so134079158obf.1
        for <user@hive.apache.org>; Tue, 05 May 2015 04:28:08 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=72bZaZnEdsNE0j/S1ShzUbh8MzJUst5wo00MwHBOrvc=;
        b=IEqwAXtn4MA8sTgBcuPWzrXv3IZnRI/gpMul//kj+isWUsf6VZK+YjVkg292ojHpaC
         nqwRddOwNtwXC+sj3+HeErD2M1tfA51P05ENMaqB1zqt06UjZ3ZZd4UGmsQE5EHjsfM7
         5OPAzzBDqlVAizYVaclziB4DQ2LrY8rzo9s1haU8Dql0HGQ0LmvUuGZrheqscuZ8xs1e
         JTtUUZYD0JibN18fUlPNCZC4g7FQc/VLLaUM7wMqaY/tOEpyjTqmKJ/vhduexr172WjC
         f5M0gYhl1SfeNwjrA5rfPn9yHRtz2C1OBwkp/3U5XSRD+E/pON/wHdEDUvqZDD3Rz0RT
         hetw==
MIME-Version: 1.0
X-Received: by 10.60.34.104 with SMTP id y8mr21972207oei.77.1430825287682;
 Tue, 05 May 2015 04:28:07 -0700 (PDT)
Received: by 10.182.65.196 with HTTP; Tue, 5 May 2015 04:28:07 -0700 (PDT)
In-Reply-To: <FD0814E9-6372-4AFF-8CA6-E0993220F78C@hortonworks.com>
References: 
 <CAJpswtT+LhEdr07tHNkij-kQLMnSZpPAc7QXwn+SWTy8cxjXFQ@mail.gmail.com>
	<FD0814E9-6372-4AFF-8CA6-E0993220F78C@hortonworks.com>
Date: Tue, 5 May 2015 16:58:07 +0530
Message-ID: 
 <CAJpswtR=hTPQf+XsPBzxoesUDiei-GTxRntyVNbEGaj_vYA6GQ@mail.gmail.com>
Subject: Re: Hive : plan serialization format option
From: "Bhagwan S. Soni" <bhgwnssoni75@gmail.com>
To: user@hive.apache.org
Content-Type: multipart/alternative; boundary=089e013cc3d8020d9a051553f914
X-Virus-Checked: Checked by ClamAV on apache.org

--089e013cc3d8020d9a051553f914
Content-Type: text/plain; charset=UTF-8

Bottom on the log:

        at java.beans.Encoder.writeObject(Encoder.java:74)

        at java.beans.XMLEncoder.writeObject(XMLEncoder.java:327)

        at java.beans.Encoder.writeExpression(Encoder.java:330)

        at java.beans.XMLEncoder.writeExpression(XMLEncoder.java:454)

        at
java.beans.DefaultPersistenceDelegate.doProperty(DefaultPersistenceDelegate.java:194)

        at
java.beans.DefaultPersistenceDelegate.initBean(DefaultPersistenceDelegate.java:256)

        ... 98 more

Caused by: java.lang.NullPointerException

        at java.lang.StringBuilder.<init>(StringBuilder.java:109)

        at
org.apache.hadoop.hive.serde2.typeinfo.BaseCharTypeInfo.getQualifiedName(BaseCharTypeInfo.java:49)

        at
org.apache.hadoop.hive.serde2.typeinfo.BaseCharTypeInfo.getQualifiedName(BaseCharTypeInfo.java:45)

        at
org.apache.hadoop.hive.serde2.typeinfo.VarcharTypeInfo.getTypeName(VarcharTypeInfo.java:37)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:75)

        at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:279)

        at java.beans.Statement.invokeInternal(Statement.java:292)

        at java.beans.Statement.access$000(Statement.java:58)

        at java.beans.Statement$2.run(Statement.java:185)

        at java.security.AccessController.doPrivileged(Native Method)

        at java.beans.Statement.invoke(Statement.java:182)

        at java.beans.Expression.getValue(Expression.java:153)

        at
java.beans.DefaultPersistenceDelegate.doProperty(DefaultPersistenceDelegate.java:193)

        at
java.beans.DefaultPersistenceDelegate.initBean(DefaultPersistenceDelegate.java:256)

        ... 111 more

Job Submission failed with exception
'java.lang.RuntimeException(java.lang.RuntimeException: Cannot serialize
object)'

FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.mr.MapRedTask

On Tue, May 5, 2015 at 3:10 PM, Jason Dere <jdere@hortonworks.com> wrote:

>  kryo/javaXML are the only available options. What are the errors you see
> with each setting?
>
>
>  On May 1, 2015, at 9:41 AM, Bhagwan S. Soni <bhgwnssoni75@gmail.com>
> wrote:
>
>   Hi Hive Users,
>
>  I'm using cloudera's hive 0.13 version which by default provide Kryo
> plan serialization format.
>  <property>
> <name>hive.plan.serialization.format</name>
> <value>*kryo*</value>
> </property>
>
>  As i'm facing issues with Kryo, can anyone help me identify the other
> open options in place of Kryo for hive plan serialization format.
>
>  I know one option javaXML, but in my case it is not working.
>
>
>
>
>
>

--089e013cc3d8020d9a051553f914
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><p>Bottom on the log:</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0 at java.beans.Encoder.writeObject(Encoder.java:74)</p><p>=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.beans.XMLEncoder.writeObjec=
t(XMLEncoder.java:327)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at =
java.beans.Encoder.writeExpression(Encoder.java:330)</p><p>=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.beans.XMLEncoder.writeExpression(XMLEnc=
oder.java:454)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.bea=
ns.DefaultPersistenceDelegate.doProperty(DefaultPersistenceDelegate.java:19=
4)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.beans.DefaultPe=
rsistenceDelegate.initBean(DefaultPersistenceDelegate.java:256)</p><p>=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ... 98 more</p><p>Caused by: java.l=
ang.NullPointerException</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 a=
t java.lang.StringBuilder.&lt;init&gt;(StringBuilder.java:109)</p><p>=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.serde2.typei=
nfo.BaseCharTypeInfo.getQualifiedName(BaseCharTypeInfo.java:49)</p><p>=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.serde2.ty=
peinfo.BaseCharTypeInfo.getQualifiedName(BaseCharTypeInfo.java:45)</p><p>=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.hive.serde2=
.typeinfo.VarcharTypeInfo.getTypeName(VarcharTypeInfo.java:37)</p><p>=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.NativeMethodAccessorImp=
l.invoke0(Native Method)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 a=
t sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java=
:57)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.Delega=
tingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)</p><p>=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.lang.reflect.Method.invo=
ke(Method.java:606)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun=
.reflect.misc.Trampoline.invoke(MethodUtil.java:75)</p><p>=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.GeneratedMethodAccessor8.invoke(=
Unknown Source)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.ref=
lect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:=
43)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.lang.reflect.M=
ethod.invoke(Method.java:606)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0 at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:279)</p><p>=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.beans.Statement.invokeInternal=
(Statement.java:292)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at ja=
va.beans.Statement.access$000(Statement.java:58)</p><p>=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0 at java.beans.Statement$2.run(Statement.java:185)<=
/p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.security.AccessCon=
troller.doPrivileged(Native Method)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0 at java.beans.Statement.invoke(Statement.java:182)</p><p>=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.beans.Expression.getValue(Expr=
ession.java:153)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.b=
eans.DefaultPersistenceDelegate.doProperty(DefaultPersistenceDelegate.java:=
193)</p><p>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.beans.Default=
PersistenceDelegate.initBean(DefaultPersistenceDelegate.java:256)</p><p>=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ... 111 more</p><p>Job Submission f=
ailed with exception &#39;java.lang.RuntimeException(java.lang.RuntimeExcep=
tion: Cannot serialize object)&#39;</p><p>FAILED: Execution Error, return c=
ode 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask</p></div><div class=
=3D"gmail_extra"><br><div class=3D"gmail_quote">On Tue, May 5, 2015 at 3:10=
 PM, Jason Dere <span dir=3D"ltr">&lt;<a href=3D"mailto:jdere@hortonworks.c=
om" target=3D"_blank">jdere@hortonworks.com</a>&gt;</span> wrote:<br><block=
quote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc=
 solid;padding-left:1ex">



<div style=3D"word-wrap:break-word">
kryo/javaXML are the only available options. What are the errors you see wi=
th each setting?
<div><div class=3D"h5"><div><br>
</div>
<div><br>
<div>
<div>On May 1, 2015, at 9:41 AM, Bhagwan S. Soni &lt;<a href=3D"mailto:bhgw=
nssoni75@gmail.com" target=3D"_blank">bhgwnssoni75@gmail.com</a>&gt; wrote:=
</div>
<br>
<blockquote type=3D"cite">
<div dir=3D"ltr">
<div>
<div>
<div>Hi Hive Users,<br>
<br>
</div>
I&#39;m using cloudera&#39;s hive 0.13 version which by default provide Kry=
o=C2=A0 plan serialization format.<br>
<span dir=3D"ltr"><font face=3D"Calibri,Arial,Helvetica,sans-serif" size=3D=
"3"><span style=3D"font-size:12pt;background-color:white">
<div style=3D"margin-top:0px;margin-bottom:0px"><span style=3D"background-c=
olor:yellow">&lt;property&gt;</span></div>
<div style=3D"margin-top:0px;margin-bottom:0px"><span style=3D"background-c=
olor:yellow">&lt;name&gt;hive.plan.serialization.format&lt;/name&gt;</span>=
</div>
<div style=3D"margin-top:0px;margin-bottom:0px"><span style=3D"background-c=
olor:yellow">&lt;value&gt;</span><span style=3D"background-color:red"><b>kr=
yo</b></span><span style=3D"background-color:yellow">&lt;/value&gt;</span><=
/div>
<div style=3D"margin-top:0px;margin-bottom:0px"><span style=3D"background-c=
olor:yellow">&lt;/property&gt;</span></div>
</span></font></span><br>
</div>
As i&#39;m facing issues with Kryo, can anyone help me identify the other o=
pen options in place of Kryo for hive plan serialization format.<br>
<br>
</div>
I know one option javaXML, but in my case it is not working.<br>
<div><span style=3D"background-color:yellow"><br>
</span><span dir=3D"ltr"><font face=3D"Calibri,Arial,Helvetica,sans-serif" =
size=3D"3"><span style=3D"font-size:12pt;background-color:white">
<div style=3D"margin-top:0px;margin-bottom:0px"><span style=3D"background-c=
olor:yellow"><br>
</span></div>
<div style=3D"margin-top:0px;margin-bottom:0px"><span style=3D"background-c=
olor:yellow"><br>
</span></div>
</span></font></span><br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div></div></div>

</blockquote></div><br></div>

--089e013cc3d8020d9a051553f914--