Return-Path: 
 <user-return-1431-apmail-avro-user-archive=avro.apache.org@avro.apache.org>
X-Original-To: apmail-avro-user-archive@www.apache.org
Delivered-To: apmail-avro-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 635B89EA3
	for <apmail-avro-user-archive@www.apache.org>;
 Thu,  2 Feb 2012 22:06:54 +0000 (UTC)
Received: (qmail 44911 invoked by uid 500); 2 Feb 2012 22:06:54 -0000
Delivered-To: apmail-avro-user-archive@avro.apache.org
Received: (qmail 44756 invoked by uid 500); 2 Feb 2012 22:06:53 -0000
Mailing-List: contact user-help@avro.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@avro.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@avro.apache.org>
List-Post: <mailto:user@avro.apache.org>
List-Id: <user.avro.apache.org>
Reply-To: user@avro.apache.org
Delivered-To: mailing list user@avro.apache.org
Received: (qmail 44724 invoked by uid 99); 2 Feb 2012 22:06:52 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 22:06:52 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of russell.jurney@gmail.com
 designates 74.125.82.49 as permitted sender)
Received: from [74.125.82.49] (HELO mail-ww0-f49.google.com) (74.125.82.49)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 22:06:47 +0000
Received: by wgbdt13 with SMTP id dt13so2495182wgb.30
        for <user@avro.apache.org>; Thu, 02 Feb 2012 14:06:26 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=bRTNjV7XM7MOXEp62Ph0D6xQRENb1vFC/SfBYCPK6XA=;
        b=Ajv41Bau+qtODRWz2aJRvu16aq+FPJLZN2rHviEp1dN0fAakBHHqCND74aoRMhfrWG
         HL8V7uDHJH9VwPRsZRi+sveEQSMDZ4nJIFepU+t/uOmotTeTLRQP2lR2u1tWuGTX24yo
         wOplZsXsIr+VAueJuIiUY//swBehddV7N0/eo=
MIME-Version: 1.0
Received: by 10.180.97.199 with SMTP id ec7mr7508279wib.8.1328220386048; Thu,
 02 Feb 2012 14:06:26 -0800 (PST)
Received: by 10.180.20.15 with HTTP; Thu, 2 Feb 2012 14:06:26 -0800 (PST)
Date: Thu, 2 Feb 2012 14:06:26 -0800
Message-ID: 
 <CANSvDjq0XPj89Uhz1RW6GzyOEo=7WLTuNrLsyiRuwS1Sx8Zkrg@mail.gmail.com>
Subject: Problem with Pig AvroStorage, with Avros that work in Ruby and Python
From: Russell Jurney <russell.jurney@gmail.com>
To: user@pig.apache.org, user@avro.apache.org
Content-Type: multipart/alternative; boundary=f46d044306a84b3c4e04b80268be

--f46d044306a84b3c4e04b80268be
Content-Type: text/plain; charset=ISO-8859-1

I am writing Avro records in Ruby using the avro ruby gem in 1.8.7.  I have
problems with loading these files sometimes.  As a result, I am unable to
write large files that are readable.

The exception I get is below.  Anyone have an idea what this means?  It
looks like Avro is having trouble parsing the schema.  The avro files parse
in Ruby and Python, just not Pig.  Are there more rigorous checks in Java?

Pig Stack Trace
---------------
ERROR 2998: Unhandled internal error.
org.codehaus.jackson.JsonFactory.enable(Lorg/codehaus/jackson/JsonParser$Feature;)Lorg/codehaus/jackson/JsonFactory;

java.lang.NoSuchMethodError:
org.codehaus.jackson.JsonFactory.enable(Lorg/codehaus/jackson/JsonParser$Feature;)Lorg/codehaus/jackson/JsonFactory;
at org.apache.avro.Schema.<clinit>(Schema.java:82)
at
org.apache.pig.piggybank.storage.avro.AvroStorageUtils.<clinit>(AvroStorageUtils.java:49)
at
org.apache.pig.piggybank.storage.avro.AvroStorage.getAvroSchema(AvroStorage.java:163)
at
org.apache.pig.piggybank.storage.avro.AvroStorage.getAvroSchema(AvroStorage.java:144)
at
org.apache.pig.piggybank.storage.avro.AvroStorage.getSchema(AvroStorage.java:269)
at
org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:150)
at
org.apache.pig.newplan.logical.relational.LOLoad.getSchema(LOLoad.java:109)
at
org.apache.pig.newplan.logical.visitor.LineageFindRelVisitor.visit(LineageFindRelVisitor.java:100)
at org.apache.pig.newplan.logical.relational.LOLoad.accept(LOLoad.java:218)
at
org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
at
org.apache.pig.newplan.logical.visitor.CastLineageSetter.<init>(CastLineageSetter.java:57)
at org.apache.pig.PigServer$Graph.compile(PigServer.java:1679)
at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1610)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1582)
at org.apache.pig.PigServer.registerQuery(PigServer.java:584)
at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:942)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:495)
at org.apache.pig.Main.main(Main.java:111)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
================================================================================

-- 
Russell Jurney
twitter.com/rjurney
russell.jurney@gmail.com
datasyndrome.com

--f46d044306a84b3c4e04b80268be
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I am writing Avro records in Ruby using the avro ruby gem in 1.8.7. =A0I ha=
ve problems with loading these files sometimes. =A0As a result, I am unable=
 to write large files that are readable.<div><br></div><div>The exception I=
 get is below. =A0Anyone have an idea what this means? =A0It looks like Avr=
o is having trouble parsing the schema. =A0The avro files parse in Ruby and=
 Python, just not Pig. =A0Are there more rigorous checks in Java?</div>
<div><br></div><div><div>Pig Stack Trace</div><div>---------------</div><di=
v>ERROR 2998: Unhandled internal error. org.codehaus.jackson.JsonFactory.en=
able(Lorg/codehaus/jackson/JsonParser$Feature;)Lorg/codehaus/jackson/JsonFa=
ctory;</div>
<div><br></div><div>java.lang.NoSuchMethodError: org.codehaus.jackson.JsonF=
actory.enable(Lorg/codehaus/jackson/JsonParser$Feature;)Lorg/codehaus/jacks=
on/JsonFactory;</div><div><span class=3D"Apple-tab-span" style=3D"white-spa=
ce:pre">	</span>at org.apache.avro.Schema.&lt;clinit&gt;(Schema.java:82)</d=
iv>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.piggybank.storage.avro.AvroStorageUtils.&lt;clinit&gt;(AvroSto=
rageUtils.java:49)</div><div><span class=3D"Apple-tab-span" style=3D"white-=
space:pre">	</span>at org.apache.pig.piggybank.storage.avro.AvroStorage.get=
AvroSchema(AvroStorage.java:163)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.piggybank.storage.avro.AvroStorage.getAvroSchema(AvroStorage.j=
ava:144)</div><div><span class=3D"Apple-tab-span" style=3D"white-space:pre"=
>	</span>at org.apache.pig.piggybank.storage.avro.AvroStorage.getSchema(Avr=
oStorage.java:269)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad=
.java:150)</div><div><span class=3D"Apple-tab-span" style=3D"white-space:pr=
e">	</span>at org.apache.pig.newplan.logical.relational.LOLoad.getSchema(LO=
Load.java:109)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.newplan.logical.visitor.LineageFindRelVisitor.visit(LineageFin=
dRelVisitor.java:100)</div><div><span class=3D"Apple-tab-span" style=3D"whi=
te-space:pre">	</span>at org.apache.pig.newplan.logical.relational.LOLoad.a=
ccept(LOLoad.java:218)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:=
75)</div><div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</s=
pan>at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.newplan.logical.visitor.CastLineageSetter.&lt;init&gt;(CastLin=
eageSetter.java:57)</div><div><span class=3D"Apple-tab-span" style=3D"white=
-space:pre">	</span>at org.apache.pig.PigServer$Graph.compile(PigServer.jav=
a:1679)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1610)</div><div><=
span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at org.apac=
he.pig.PigServer$Graph.registerQuery(PigServer.java:1582)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.PigServer.registerQuery(PigServer.java:584)</div><div><span cl=
ass=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at org.apache.pig.=
tools.grunt.GruntParser.processPig(GruntParser.java:942)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.j=
ava:386)</div><div><span class=3D"Apple-tab-span" style=3D"white-space:pre"=
>	</span>at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntPa=
rser.java:188)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)=
</div><div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span=
>at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.pig.Main.run(Main.java:495)</div><div><span class=3D"Apple-tab-spa=
n" style=3D"white-space:pre">	</span>at org.apache.pig.Main.main(Main.java:=
111)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at su=
n.reflect.NativeMethodAccessorImpl.invoke0(Native Method)</div><div><span c=
lass=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at sun.reflect.Na=
tiveMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at su=
n.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.=
java:25)</div><div><span class=3D"Apple-tab-span" style=3D"white-space:pre"=
>	</span>at java.lang.reflect.Method.invoke(Method.java:597)</div>
<div><span class=3D"Apple-tab-span" style=3D"white-space:pre">	</span>at or=
g.apache.hadoop.util.RunJar.main(RunJar.java:156)</div><div>=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
</div><div>
<br></div>-- <br><span style=3D"border-collapse:collapse;font-family:arial,=
sans-serif;font-size:13px">Russell Jurney<br><a href=3D"http://twitter.com/=
rjurney" style=3D"color:rgb(0,0,204)" target=3D"_blank">twitter.<span style=
=3D"background-color:rgb(255,255,136);color:rgb(34,34,34);background-repeat=
:initial initial">com</span>/rjurney</a><br>
<font color=3D"#888888"><a href=3D"mailto:russell.jurney@gmail.com" style=
=3D"color:rgb(0,0,204)" target=3D"_blank">russell.jurney@gmail.<span style=
=3D"background-color:rgb(255,255,136);color:rgb(34,34,34);background-repeat=
:initial initial">com</span></a><br>
<a href=3D"http://datasyndrome.com/" style=3D"color:rgb(0,0,204)" target=3D=
"_blank"><span style=3D"background-color:rgb(255,255,136);color:rgb(34,34,3=
4);background-repeat:initial initial">datasyndrome</span>.<span style=3D"ba=
ckground-color:rgb(255,255,136);color:rgb(34,34,34);background-repeat:initi=
al initial">com</span></a></font></span><br>

</div>

--f46d044306a84b3c4e04b80268be--