hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Timm <tim...@aol.com>
Subject "One schema is null" error loading data with pig BinStorage
Date Fri, 02 Jan 2009 22:15:26 GMT
Using a small set of my data, I can process it, write it to BinStorage 
and load it again.  When I use a larger set, I get an error 
"java.io.IOException: One schema is null [One schema is null]" when 
loading the data.  I don't see any errors in the logs processing the 
data.  The stack trace is below.

Thanks,
Sean

grunt> A = load '/tmp/1113clusterOut-d0' USING BinStorage();
funcSpec: BinStorage
java.io.IOException: One schema is null [One schema is null]
        at 
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1245)
        at 
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305)
        at 
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305)
        at 
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305)
        at 
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305)
        at 
org.apache.pig.data.DataType.determineFieldSchema(DataType.java:793)
        at 
org.apache.pig.builtin.BinStorage.determineSchema(BinStorage.java:229)
        at 
org.apache.pig.impl.logicalLayer.LOLoad.getSchema(LOLoad.java:136)
        at 
org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:584)
        at 
org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:60)
        at org.apache.pig.PigServer.parseQuery(PigServer.java:295)
        at org.apache.pig.PigServer.registerQuery(PigServer.java:263)
        at 
org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:439)
        at 
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:249)
        at 
org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:94)
        at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
        at org.apache.pig.Main.main(Main.java:282)
Caused by: org.apache.pig.impl.logicalLayer.schema.SchemaMergeException: 
One schema is null
        ... 17 more
2009-01-02 17:10:12,265 [main] ERROR 
org.apache.pig.tools.grunt.GruntParser - 
java.lang.IllegalStateException: Can't overwrite cause
        at java.lang.Throwable.initCause(Throwable.java:320)
        at 
org.apache.pig.impl.logicalLayer.LOLoad.getSchema(LOLoad.java:143)
        at 
org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:584)
        at 
org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:60)
        at org.apache.pig.PigServer.parseQuery(PigServer.java:295)
        at org.apache.pig.PigServer.registerQuery(PigServer.java:263)
        at 
org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:439)
        at 
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:249)
        at 
org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:94)
        at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
        at org.apache.pig.Main.main(Main.java:282)

2009-01-02 17:10:12,265 [main] ERROR 
org.apache.pig.tools.grunt.GruntParser - Can't overwrite cause
2009-01-02 17:10:12,265 [main] ERROR 
org.apache.pig.tools.grunt.GruntParser - 
java.lang.IllegalStateException: Can't overwrite cause


Mime
View raw message