Return-Path: 
 <user-return-2500-apmail-avro-user-archive=avro.apache.org@avro.apache.org>
X-Original-To: apmail-avro-user-archive@www.apache.org
Delivered-To: apmail-avro-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 35B28CEF9
	for <apmail-avro-user-archive@www.apache.org>;
 Mon, 17 Jun 2013 03:16:07 +0000 (UTC)
Received: (qmail 15736 invoked by uid 500); 17 Jun 2013 03:16:04 -0000
Delivered-To: apmail-avro-user-archive@avro.apache.org
Received: (qmail 15646 invoked by uid 500); 17 Jun 2013 03:15:57 -0000
Mailing-List: contact user-help@avro.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@avro.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@avro.apache.org>
List-Post: <mailto:user@avro.apache.org>
List-Id: <user.avro.apache.org>
Reply-To: user@avro.apache.org
Delivered-To: mailing list user@avro.apache.org
Received: (qmail 15609 invoked by uid 99); 17 Jun 2013 03:15:55 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Jun 2013 03:15:55 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of dongre.avinash@gmail.com
 designates 74.125.82.173 as permitted sender)
Received: from [74.125.82.173] (HELO mail-we0-f173.google.com) (74.125.82.173)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Jun 2013 03:15:49 +0000
Received: by mail-we0-f173.google.com with SMTP id x54so1912242wes.18
        for <user@avro.apache.org>; Sun, 16 Jun 2013 20:15:29 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=Ra1yL+sOFsuUbHc4RXgrq1Uf793b5o93sis+QCi2F5k=;
        b=x6eCOb4dHAgpbuI8vY0FcdvqB/ECVk43ClIXpW26ek7/fGd53qA06ClUhcQ9H6A0Sf
         sTe+BEx55VewCuiZKwT70Yivv+UIlTaCjmNvBEwzpcLzcQvANYs2k+8fqgAha1Ph0dzx
         8DkGXV4ZLd0fiQ97pBSM/nC6/flLS3eLs4/oHuBeKpVb2/mvZz8rBiNFT6uN1jdVkSsq
         4fUNlwm0WLuCKFE0N2IYVWAO1tQIypEFEFypjecXOBLdRPAVH1rcgEB+uFMEHY+cgOJV
         Q86QIjSvA6y7a3QjxgxUa/6rt7xyg5cN/c1zbPeG3pp2g5Yq1f0N8bgszNa+4Mh+0PaO
         yH5g==
MIME-Version: 1.0
X-Received: by 10.194.108.73 with SMTP id hi9mr6700722wjb.85.1371438929484;
 Sun, 16 Jun 2013 20:15:29 -0700 (PDT)
Received: by 10.194.22.231 with HTTP; Sun, 16 Jun 2013 20:15:29 -0700 (PDT)
In-Reply-To: 
 <CAJ7_Jgg=7AHmjZEENqE=R+-OCKEePhorQVzQG3Q-0q9Dh4L0ew@mail.gmail.com>
References: 
 <CAJ7_Jgg=7AHmjZEENqE=R+-OCKEePhorQVzQG3Q-0q9Dh4L0ew@mail.gmail.com>
Date: Mon, 17 Jun 2013 08:45:29 +0530
Message-ID: 
 <CAJ7_Jgjd41EdJDi+=-eiyQ+fSnzwk90F8T7yAHOi=iwhMU8+qQ@mail.gmail.com>
Subject: Re: Sending Apache avro serialized data to thrift server
From: Avinash Dongre <dongre.avinash@gmail.com>
To: user@avro.apache.org
Content-Type: multipart/alternative; boundary=047d7bf10b283923f704df5102bd
X-Virus-Checked: Checked by ClamAV on apache.org

--047d7bf10b283923f704df5102bd
Content-Type: text/plain; charset=ISO-8859-1

> Hi,
> I am trying to send avro serialized data to my thrift server. But when I
> try to de-serialized I get exception
> org.apache.avro.AvroRuntimeException: Malformed data. Length is negative:
> -51
>
> If I do the same operation in the same vm process everything works fine.
>
> Here is my small code.
>
> public static GenericRecord createContentNestedObject() throws Exception {
>     GenericRecord image1 = new GenericData.Record(IMAGE_SCHEMA);
>     image1.put("uri", new Utf8("http://javaone.com/keynote_large.jpg"));
>     image1.put("width", 0);
>     image1.put("height", 0);
>     image1.put("size", 2);
>     image1.put("title", new Utf8("Javaone Keynote"));
>     return image1;
>   }
>
>   // Helper Method to serialize the object from avro to bytebuffer
>   public static ByteBuffer serialize(GenericRecord content, Schema schema)
>       throws Exception {
>
>     ByteArrayOutputStream out = new ByteArrayOutputStream();
>     DatumWriter<GenericRecord> writer = new
> GenericDatumWriter<GenericRecord>(
>         schema);
>     // create Binary Encoder
>     EncoderFactory ef = new EncoderFactory();
>     BinaryEncoder be = ef.binaryEncoder(out, null);
>     writer.write(content, be);
>     be.flush();
>     out.close();
>
>     return ByteBuffer.wrap(out.toByteArray());
>   }
>
>   public static void main(String[] args) throws Exception {
>     try {
>       GenericRecord rd = createContentNestedObject();
>       bf = serialize(rd, IMAGE_SCHEMA);
>
>     } catch (Exception e) {
>       // TODO Auto-generated catch block
>       e.printStackTrace();
>     }
>
>     // Deserialization.
>     DatumReader<GenericRecord> reader = new
> GenericDatumReader<GenericRecord>(IMAGE_SCHEMA_1);
>     ByteArrayOutputStream out = new ByteArrayOutputStream();
>     try {
>       out.write(bf.array());
>     } catch (IOException e1) {
>       // TODO Auto-generated catch block
>       e1.printStackTrace();
>     }
>     BinaryDecoder decoder =
> DecoderFactory.get().binaryDecoder(out.toByteArray(), null);
>     try {
>       GenericRecord result = reader.read(null, decoder);
>       System.out.println("RESULT : " + result.toString());
>     } catch (IOException e) {
>       // TODO Auto-generated catch block
>       e.printStackTrace();
>     }
>
> This code works. When I send the bf to my thrift api , I am getting the
> error,
> my thrift api is simple which accept ByteBuffer and try to deserialize it.
>
> following is the code in the thrift server api
>
> DatumReader<GenericRecord> reader = new
> GenericDatumReader<GenericRecord>(IMAGE_SCHEMA_1);
>     ByteArrayOutputStream out = new ByteArrayOutputStream();
>     try {
>       out.write(bf.array());
>     } catch (IOException e1) {
>       // TODO Auto-generated catch block
>       e1.printStackTrace();
>     }
>     BinaryDecoder decoder =
> DecoderFactory.get().binaryDecoder(out.toByteArray(), null);
>     try {
>       GenericRecord result = reader.read(null, decoder);
>       System.out.println("RESULT : " + result.toString());
>     } catch (IOException e) {
>       // TODO Auto-generated catch block
>       e.printStackTrace();
>     }
>
>
>
> What is wrong here.
>
>
> Thanks
> Aviansh
>
>
>

--047d7bf10b283923f704df5102bd
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><br><div class=3D"gmail_extra"><div class=3D"gmail_quote">=
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div>I am trying to send=
 avro serialized data to my thrift server. But when I try to de-serialized =
I get exception=A0</div>
<div><div>org.apache.avro.AvroRuntimeException: Malformed data. Length is n=
egative: -51</div>
</div><div><br></div><div>If I do the same operation in the same vm process=
 everything works fine.</div><div><br></div><div>Here is my small code.</di=
v><div><br></div><div><div>public static GenericRecord createContentNestedO=
bject() throws Exception {</div>

<div>=A0 =A0 GenericRecord image1 =3D new GenericData.Record(IMAGE_SCHEMA);=
</div><div>=A0 =A0 image1.put(&quot;uri&quot;, new Utf8(&quot;<a href=3D"ht=
tp://javaone.com/keynote_large.jpg" target=3D"_blank">http://javaone.com/ke=
ynote_large.jpg</a>&quot;));</div>

<div>=A0 =A0 image1.put(&quot;width&quot;, 0);</div><div>=A0 =A0 image1.put=
(&quot;height&quot;, 0);</div><div>=A0 =A0 image1.put(&quot;size&quot;, 2);=
</div><div>=A0 =A0 image1.put(&quot;title&quot;, new Utf8(&quot;Javaone Key=
note&quot;));</div>

<div>=A0 =A0 return image1;</div><div>=A0 }</div><div><br></div><div>=A0 //=
 Helper Method to serialize the object from avro to bytebuffer</div><div>=
=A0 public static ByteBuffer serialize(GenericRecord content, Schema schema=
)</div>
<div>
=A0 =A0 =A0 throws Exception {</div><div><br></div><div>=A0 =A0 ByteArrayOu=
tputStream out =3D new ByteArrayOutputStream();</div><div>=A0 =A0 DatumWrit=
er&lt;GenericRecord&gt; writer =3D new GenericDatumWriter&lt;GenericRecord&=
gt;(</div><div>

=A0 =A0 =A0 =A0 schema);</div><div>=A0 =A0 // create Binary Encoder</div><d=
iv>=A0 =A0 EncoderFactory ef =3D new EncoderFactory();</div><div>=A0 =A0 Bi=
naryEncoder be =3D ef.binaryEncoder(out, null);</div><div>=A0 =A0 writer.wr=
ite(content, be);</div>
<div>
=A0 =A0 be.flush();</div><div>=A0 =A0 out.close();</div><div><br></div><div=
>=A0 =A0 return ByteBuffer.wrap(out.toByteArray());</div><div>=A0 }</div><d=
iv><br></div><div>=A0 public static void main(String[] args) throws Excepti=
on {</div><div>

=A0 =A0 try {<br></div><div>=A0 =A0 =A0 GenericRecord rd =3D createContentN=
estedObject();</div><div>=A0 =A0 =A0 bf =3D serialize(rd, IMAGE_SCHEMA);</d=
iv><div>=A0 =A0 =A0=A0<br></div><div>=A0 =A0 } catch (Exception e) {</div><=
div>=A0 =A0 =A0 // TODO Auto-generated catch block</div>

<div>=A0 =A0 =A0 e.printStackTrace();</div><div>=A0 =A0 }</div><div>=A0 =A0=
=A0</div><div>=A0 =A0 // Deserialization.=A0</div><div>=A0 =A0 DatumReader&=
lt;GenericRecord&gt; reader =3D new GenericDatumReader&lt;GenericRecord&gt;=
(IMAGE_SCHEMA_1); =A0 =A0<br>

</div><div>=A0 =A0 ByteArrayOutputStream out =3D new ByteArrayOutputStream(=
);</div><div>=A0 =A0 try {</div><div>=A0 =A0 =A0 out.write(bf.array());</di=
v><div>=A0 =A0 } catch (IOException e1) {</div><div>=A0 =A0 =A0 // TODO Aut=
o-generated catch block</div>

<div>=A0 =A0 =A0 e1.printStackTrace();</div><div>=A0 =A0 } =A0 =A0</div><di=
v>=A0 =A0 BinaryDecoder decoder =3D DecoderFactory.get().binaryDecoder(out.=
toByteArray(), null); =A0</div><div>=A0 =A0 try {</div><div>=A0 =A0 =A0 Gen=
ericRecord result =3D reader.read(null, decoder);</div>

<div>=A0 =A0 =A0 System.out.println(&quot;RESULT : &quot; + result.toString=
());</div><div>=A0 =A0 } catch (IOException e) {</div><div>=A0 =A0 =A0 // T=
ODO Auto-generated catch block</div><div>=A0 =A0 =A0 e.printStackTrace();</=
div><div>=A0 =A0 }</div>

<div><br></div><div>This code works. When I send the bf to my thrift api , =
I am getting the error,=A0</div><div>my thrift api is simple which accept B=
yteBuffer and try to deserialize it.</div><div><br></div>
<div>following is the code in the thrift server api</div><div><br></div><di=
v><div>DatumReader&lt;GenericRecord&gt; reader =3D new GenericDatumReader&l=
t;GenericRecord&gt;(IMAGE_SCHEMA_1); =A0 =A0<br></div><div>
=A0 =A0 ByteArrayOutputStream out =3D new ByteArrayOutputStream();</div><di=
v>=A0 =A0 try {</div><div>=A0 =A0 =A0 out.write(bf.array());</div><div>=A0 =
=A0 } catch (IOException e1) {</div><div>=A0 =A0 =A0 // TODO Auto-generated=
 catch block</div><div>

=A0 =A0 =A0 e1.printStackTrace();</div><div>=A0 =A0 } =A0 =A0</div><div>=A0=
 =A0 BinaryDecoder decoder =3D DecoderFactory.get().binaryDecoder(out.toByt=
eArray(), null); =A0</div><div>=A0 =A0 try {</div><div>=A0 =A0 =A0 GenericR=
ecord result =3D reader.read(null, decoder);</div>

<div>=A0 =A0 =A0 System.out.println(&quot;RESULT : &quot; + result.toString=
());</div><div>=A0 =A0 } catch (IOException e) {</div><div>=A0 =A0 =A0 // T=
ODO Auto-generated catch block</div><div>=A0 =A0 =A0 e.printStackTrace();</=
div><div>=A0 =A0 }</div>

<div><br></div><div><br></div><div><br></div><div>What is wrong here.</div>=
<div><br></div><div><br></div><div>Thanks</div><div>Aviansh</div><div><br><=
/div></div><div><br></div></div>
</div>
</blockquote></div><br></div></div>

--047d7bf10b283923f704df5102bd--