pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Curtis Strite <curtis.str...@answers.com>
Subject Re: [jira] [Commented] (PIG-2963) Illustrate command and POPackageLite
Date Mon, 15 Oct 2012 19:59:20 GMT
How do I remove myself from this distro?



Thanks,
Curtis



On Mon, Oct 15, 2012 at 2:57 PM, Jonathan Coveney (JIRA) <jira@apache.org>wrote:

>
>     [
> https://issues.apache.org/jira/browse/PIG-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13476372#comment-13476372]
>
> Jonathan Coveney commented on PIG-2963:
> ---------------------------------------
>
> Allan: it comes down to pestering a committer to reviewing and committing,
> or just hoping they look at it.
>
> Which I just did. Thanks for the fix, Cheolsoo. It's in!
>
> > Illustrate command and POPackageLite
> > ------------------------------------
> >
> >                 Key: PIG-2963
> >                 URL: https://issues.apache.org/jira/browse/PIG-2963
> >             Project: Pig
> >          Issue Type: Bug
> >            Reporter: Allan AvendaƱo
> >            Assignee: Cheolsoo Park
> >            Priority: Critical
> >             Fix For: 0.11
> >
> >         Attachments: PIG-2963.patch
> >
> >
> > While trying to execute a simple script like:
> > A = LOAD 'test01' AS (f1:chararray,f2:int,f3:chararray);
> > B = order A by f1;
> > illustrate B;
> > or
> > C = foreach B generate f1, f2;
> > illustrate C;
> > I got the following exception:
> > java.lang.RuntimeException: ReadOnceBag does not support getMemorySize
> operation
> >       at
> org.apache.pig.data.ReadOnceBag.getMemorySize(ReadOnceBag.java:74)
> >       at org.apache.pig.data.SizeUtil.getPigObjMemSize(SizeUtil.java:61)
> >       at
> org.apache.pig.data.DefaultTuple.getMemorySize(DefaultTuple.java:180)
> >       at
> org.apache.pig.pen.util.ExampleTuple.getMemorySize(ExampleTuple.java:97)
> >       at
> org.apache.pig.data.DefaultAbstractBag.getMemorySize(DefaultAbstractBag.java:148)
> >       at
> org.apache.pig.data.DefaultAbstractBag.markSpillableIfNecessary(DefaultAbstractBag.java:100)
> >       at
> org.apache.pig.data.DefaultAbstractBag.add(DefaultAbstractBag.java:92)
> >       at org.apache.pig.pen.Illustrator.addData(Illustrator.java:116)
> >       at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackageLite.illustratorMarkup(POPackageLite.java:227)
> >       at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackageLite.getNext(POPackageLite.java:182)
> >       at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:422)
> >       at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:413)
> >       at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:257)
> >       at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
> >       at
> org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimulator.java:235)
> >       at
> org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257)
> >       at
> org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:238)
> >       at
> org.apache.pig.pen.LineageTrimmingVisitor.init(LineageTrimmingVisitor.java:103)
> >       at
> org.apache.pig.pen.LineageTrimmingVisitor.<init>(LineageTrimmingVisitor.java:98)
> >       at
> org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:166)
> >       at org.apache.pig.PigServer.getExamples(PigServer.java:1180)
> >       at
> org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:738)
> >       at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScriptParser.java:626)
> >       at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:323)
> >       at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:193)
> >       at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:169)
> >       at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
> >       at org.apache.pig.Main.run(Main.java:538)
> >       at org.apache.pig.Main.main(Main.java:154)
> >       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >       at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >       at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >       at java.lang.reflect.Method.invoke(Method.java:597)
> >       at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> > ======================================================================
> > At log file, the following:
> > Pig Stack Trace
> > ---------------
> > ERROR 2997: Encountered IOException. Exception
> > java.io.IOException: Exception
> >         at org.apache.pig.PigServer.getExamples(PigServer.java:1186)
> >         at
> org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:738)
> >         at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScriptParser.java:626)
> >         at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:323)
> >         at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:193)
> >         at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:169)
> >         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
> >         at org.apache.pig.Main.run(Main.java:538)
> >         at org.apache.pig.Main.main(Main.java:154)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> > Caused by: java.lang.RuntimeException: ReadOnceBag does not support
> getMemorySize operation
> >         at
> org.apache.pig.data.ReadOnceBag.getMemorySize(ReadOnceBag.java:74)
> >         at
> org.apache.pig.data.SizeUtil.getPigObjMemSize(SizeUtil.java:61)
> >         at
> org.apache.pig.data.DefaultTuple.getMemorySize(DefaultTuple.java:180)
> >         at
> org.apache.pig.pen.util.ExampleTuple.getMemorySize(ExampleTuple.java:97)
> >         at
> org.apache.pig.data.DefaultAbstractBag.getMemorySize(DefaultAbstractBag.java:148)
> >         at
> org.apache.pig.data.DefaultAbstractBag.markSpillableIfNecessary(DefaultAbstractBag.java:100)
> >         at
> org.apache.pig.data.DefaultAbstractBag.add(DefaultAbstractBag.java:92)
> >         at org.apache.pig.pen.Illustrator.addData(Illustrator.java:116)
> >         at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackageLite.illustratorMarkup(POPackageLite.java:227)
> >         at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackageLite.getNext(POPackageLite.java:182)
> >         at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:422)
> >         at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:413)
> >         at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:257)
> >         at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
> >         at
> org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimulator.java:235)
> >         at
> org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257)
> >         at
> org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:238)
> >         at
> org.apache.pig.pen.LineageTrimmingVisitor.init(LineageTrimmingVisitor.java:103)
> >         at
> org.apache.pig.pen.LineageTrimmingVisitor.<init>(LineageTrimmingVisitor.java:98)
> >         at
> org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:166)
> >         at org.apache.pig.PigServer.getExamples(PigServer.java:1180)
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA
> administrators
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message