Return-Path: X-Original-To: apmail-pig-dev-archive@www.apache.org Delivered-To: apmail-pig-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2E2F7D500 for ; Mon, 15 Oct 2012 20:13:51 +0000 (UTC) Received: (qmail 82109 invoked by uid 500); 15 Oct 2012 20:13:50 -0000 Delivered-To: apmail-pig-dev-archive@pig.apache.org Received: (qmail 82076 invoked by uid 500); 15 Oct 2012 20:13:50 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Delivered-To: moderator for dev@pig.apache.org Received: (qmail 29217 invoked by uid 500); 15 Oct 2012 19:59:46 -0000 Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of curtis.strite@answers.com designates 209.85.212.170 as permitted sender) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:x-gm-message-state; bh=168JkGSOBExr/BUdahaRU+m18fWfjYZOG68QOTAfEDU=; b=YjGWYwns3x11S00fekga7gMUOe5j9n56kpSGsv35hZ+wYYRdrudV5kfuIeRkG9Lq1v MJ+5jTwXwPZXVdO2F4WREqPC1uhWBdHEn3TA3pKzXtvmrmnnVPern4+k2EVOrgad3025 5rZaEXiOVu/WYPXesGS9E8yPM61Tm+9WfDK+TnOvdkU0KPYcXuJIV5L5SiZw4YHyqaMd UebrsReZZi1XbfjGue/jlzlYjN30LYZFIexwG5kxOL+0PDm3GENYLIuLQ9feXf72Gjj3 V5YVqL10vL9yw9HHBtD2L3m4Trdy35Cz4XRDKE3lJnCV+16Ssy2tIig9o+FltezeIBY8 /D9w== MIME-Version: 1.0 In-Reply-To: <1146229588.46978.1350331023841.JavaMail.jiratomcat@arcas> References: <745273520.20039.1349880783300.JavaMail.jiratomcat@arcas> <1146229588.46978.1350331023841.JavaMail.jiratomcat@arcas> Date: Mon, 15 Oct 2012 14:59:20 -0500 Message-ID: Subject: Re: [jira] [Commented] (PIG-2963) Illustrate command and POPackageLite From: Curtis Strite To: dev@pig.apache.org Cc: pig-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016e6d77d3520a4b004cc1e79de X-Gm-Message-State: ALoCoQn8biwl4kc5KZK5gMBqAPU51ejGk7lmszLVwC34lpSEqJJ2J37kOz+Rk1NOKtODFHbAWWeI X-Virus-Checked: Checked by ClamAV on apache.org --0016e6d77d3520a4b004cc1e79de Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable How do I remove myself from this distro? Thanks, Curtis On Mon, Oct 15, 2012 at 2:57 PM, Jonathan Coveney (JIRA) w= rote: > > [ > https://issues.apache.org/jira/browse/PIG-2963?page=3Dcom.atlassian.jira.= plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D13476372#c= omment-13476372] > > Jonathan Coveney commented on PIG-2963: > --------------------------------------- > > Allan: it comes down to pestering a committer to reviewing and committing= , > or just hoping they look at it. > > Which I just did. Thanks for the fix, Cheolsoo. It's in! > > > Illustrate command and POPackageLite > > ------------------------------------ > > > > Key: PIG-2963 > > URL: https://issues.apache.org/jira/browse/PIG-2963 > > Project: Pig > > Issue Type: Bug > > Reporter: Allan Avenda=F1o > > Assignee: Cheolsoo Park > > Priority: Critical > > Fix For: 0.11 > > > > Attachments: PIG-2963.patch > > > > > > While trying to execute a simple script like: > > A =3D LOAD 'test01' AS (f1:chararray,f2:int,f3:chararray); > > B =3D order A by f1; > > illustrate B; > > or > > C =3D foreach B generate f1, f2; > > illustrate C; > > I got the following exception: > > java.lang.RuntimeException: ReadOnceBag does not support getMemorySize > operation > > at > org.apache.pig.data.ReadOnceBag.getMemorySize(ReadOnceBag.java:74) > > at org.apache.pig.data.SizeUtil.getPigObjMemSize(SizeUtil.java:61= ) > > at > org.apache.pig.data.DefaultTuple.getMemorySize(DefaultTuple.java:180) > > at > org.apache.pig.pen.util.ExampleTuple.getMemorySize(ExampleTuple.java:97) > > at > org.apache.pig.data.DefaultAbstractBag.getMemorySize(DefaultAbstractBag.j= ava:148) > > at > org.apache.pig.data.DefaultAbstractBag.markSpillableIfNecessary(DefaultAb= stractBag.java:100) > > at > org.apache.pig.data.DefaultAbstractBag.add(DefaultAbstractBag.java:92) > > at org.apache.pig.pen.Illustrator.addData(Illustrator.java:116) > > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOpe= rators.POPackageLite.illustratorMarkup(POPackageLite.java:227) > > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOpe= rators.POPackageLite.getNext(POPackageLite.java:182) > > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMa= pReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:422) > > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMa= pReduce$Reduce.reduce(PigGenericMapReduce.java:413) > > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMa= pReduce$Reduce.reduce(PigGenericMapReduce.java:257) > > at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176) > > at > org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimula= tor.java:235) > > at > org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257) > > at > org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:238) > > at > org.apache.pig.pen.LineageTrimmingVisitor.init(LineageTrimmingVisitor.jav= a:103) > > at > org.apache.pig.pen.LineageTrimmingVisitor.(LineageTrimmingVisitor.j= ava:98) > > at > org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:166= ) > > at org.apache.pig.PigServer.getExamples(PigServer.java:1180) > > at > org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java= :738) > > at > org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScrip= tParser.java:626) > > at > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptPars= er.java:323) > > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:= 193) > > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:= 169) > > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69) > > at org.apache.pig.Main.run(Main.java:538) > > at org.apache.pig.Main.main(Main.java:154) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > > at java.lang.reflect.Method.invoke(Method.java:597) > > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > At log file, the following: > > Pig Stack Trace > > --------------- > > ERROR 2997: Encountered IOException. Exception > > java.io.IOException: Exception > > at org.apache.pig.PigServer.getExamples(PigServer.java:1186) > > at > org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java= :738) > > at > org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScrip= tParser.java:626) > > at > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptPars= er.java:323) > > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:= 193) > > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:= 169) > > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69) > > at org.apache.pig.Main.run(Main.java:538) > > at org.apache.pig.Main.main(Main.java:154) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > > at java.lang.reflect.Method.invoke(Method.java:597) > > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > > Caused by: java.lang.RuntimeException: ReadOnceBag does not support > getMemorySize operation > > at > org.apache.pig.data.ReadOnceBag.getMemorySize(ReadOnceBag.java:74) > > at > org.apache.pig.data.SizeUtil.getPigObjMemSize(SizeUtil.java:61) > > at > org.apache.pig.data.DefaultTuple.getMemorySize(DefaultTuple.java:180) > > at > org.apache.pig.pen.util.ExampleTuple.getMemorySize(ExampleTuple.java:97) > > at > org.apache.pig.data.DefaultAbstractBag.getMemorySize(DefaultAbstractBag.j= ava:148) > > at > org.apache.pig.data.DefaultAbstractBag.markSpillableIfNecessary(DefaultAb= stractBag.java:100) > > at > org.apache.pig.data.DefaultAbstractBag.add(DefaultAbstractBag.java:92) > > at org.apache.pig.pen.Illustrator.addData(Illustrator.java:116) > > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOpe= rators.POPackageLite.illustratorMarkup(POPackageLite.java:227) > > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOpe= rators.POPackageLite.getNext(POPackageLite.java:182) > > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMa= pReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:422) > > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMa= pReduce$Reduce.reduce(PigGenericMapReduce.java:413) > > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMa= pReduce$Reduce.reduce(PigGenericMapReduce.java:257) > > at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176) > > at > org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimula= tor.java:235) > > at > org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257) > > at > org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:238) > > at > org.apache.pig.pen.LineageTrimmingVisitor.init(LineageTrimmingVisitor.jav= a:103) > > at > org.apache.pig.pen.LineageTrimmingVisitor.(LineageTrimmingVisitor.j= ava:98) > > at > org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:166= ) > > at org.apache.pig.PigServer.getExamples(PigServer.java:1180) > > -- > This message is automatically generated by JIRA. > If you think it was sent incorrectly, please contact your JIRA > administrators > For more information on JIRA, see: http://www.atlassian.com/software/jira > --0016e6d77d3520a4b004cc1e79de--