avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nishanth S <chinchu2...@gmail.com>
Subject Error when running Avro map reduce 2
Date Fri, 26 Jun 2015 20:20:42 GMT
Hello  All,
I am  getting the below error on  running a map reduce job to ouput avro
files  when running map reduce locally.

I am not setting the output schemas to  Avrojob  but I am setting them
in AvroMultipleOutputs.addNamedOutput since I have multiple schemas.Request
your help.

Avro version: 1.7.7
Hadoop : 2.5

2015-06-26 14:16:40 WARN  LocalJobRunner:560 - job_local2030957284_0001
java.lang.Exception: java.lang.IllegalStateException: Writer schema for
output key was not set. Use AvroJob.setOutputKeySchema().
at
org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.IllegalStateException: Writer schema for output key
was not set. Use AvroJob.setOutputKeySchema().
at
org.apache.avro.hadoop.io.AvroDatumConverterFactory.create(AvroDatumConverterFactory.java:94)
at
org.apache.avro.mapreduce.AvroKeyValueOutputFormat.getRecordWriter(AvroKeyValueOutputFormat.java:55)
at
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:624)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:744)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)

Mime
View raw message