hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ian Holsman <li...@holsman.net>
Subject Re: "One schema is null" error loading data with pig BinStorage
Date Sat, 03 Jan 2009 11:10:10 GMT
Hey Sean.
you would be best asking this question on the 'pig-user' mailing list, 
and specifying which version of pig  (and hadoop) you are running 
against. FWIW I run my stuff with the 'types' branch, but I don't use 
BinStorage (I use mainly custom loaders/writers)

Regards
Ian

Sean Timm wrote:
> Using a small set of my data, I can process it, write it to BinStorage 
> and load it again.  When I use a larger set, I get an error 
> "java.io.IOException: One schema is null [One schema is null]" when 
> loading the data.  I don't see any errors in the logs processing the 
> data.  The stack trace is below.
>
> Thanks,
> Sean
>
> grunt> A = load '/tmp/1113clusterOut-d0' USING BinStorage();
> funcSpec: BinStorage
> java.io.IOException: One schema is null [One schema is null]
>        at 
> org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1245) 
>
>        at 
> org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305) 
>
>        at 
> org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305) 
>
>        at 
> org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305) 
>
>        at 
> org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305) 
>
>        at 
> org.apache.pig.data.DataType.determineFieldSchema(DataType.java:793)
>        at 
> org.apache.pig.builtin.BinStorage.determineSchema(BinStorage.java:229)
>        at 
> org.apache.pig.impl.logicalLayer.LOLoad.getSchema(LOLoad.java:136)
>        at 
> org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:584) 
>
>        at 
> org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:60)

>
>        at org.apache.pig.PigServer.parseQuery(PigServer.java:295)
>        at org.apache.pig.PigServer.registerQuery(PigServer.java:263)
>        at 
> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:439)
>        at 
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:249)

>
>        at 
> org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:94) 
>
>        at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
>        at org.apache.pig.Main.main(Main.java:282)
> Caused by: 
> org.apache.pig.impl.logicalLayer.schema.SchemaMergeException: One 
> schema is null
>        ... 17 more
> 2009-01-02 17:10:12,265 [main] ERROR 
> org.apache.pig.tools.grunt.GruntParser - 
> java.lang.IllegalStateException: Can't overwrite cause
>        at java.lang.Throwable.initCause(Throwable.java:320)
>        at 
> org.apache.pig.impl.logicalLayer.LOLoad.getSchema(LOLoad.java:143)
>        at 
> org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:584) 
>
>        at 
> org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:60)

>
>        at org.apache.pig.PigServer.parseQuery(PigServer.java:295)
>        at org.apache.pig.PigServer.registerQuery(PigServer.java:263)
>        at 
> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:439)
>        at 
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:249)

>
>        at 
> org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:94) 
>
>        at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
>        at org.apache.pig.Main.main(Main.java:282)
>
> 2009-01-02 17:10:12,265 [main] ERROR 
> org.apache.pig.tools.grunt.GruntParser - Can't overwrite cause
> 2009-01-02 17:10:12,265 [main] ERROR 
> org.apache.pig.tools.grunt.GruntParser - 
> java.lang.IllegalStateException: Can't overwrite cause
>
>


Mime
View raw message