hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raul Gutierrez Segales (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4950) MR App Master fails to write the history due to AvroTypeException
Date Sun, 19 Jun 2016 19:34:05 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15338740#comment-15338740
] 

Raul Gutierrez Segales commented on MAPREDUCE-4950:
---------------------------------------------------

[~fengshen], [~banasc], [~devaraj.k]: did you ever get to the root cause? I am seeing and
I suspect it has something to do with speculative maps on big jobs.. Any luck when disabling
speculative execution?



> MR App Master fails to write the history due to AvroTypeException
> -----------------------------------------------------------------
>
>                 Key: MAPREDUCE-4950
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4950
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver, mr-am
>            Reporter: Devaraj K
>            Priority: Critical
>
> {code:xml}
> 2013-01-19 19:31:27,269 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
In stop, writing event MAP_ATTEMPT_STARTED
> 2013-01-19 19:31:27,269 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.service.CompositeService:
Error stopping JobHistoryEventHandler
> org.apache.avro.AvroTypeException: Attempt to process a enum when a array-start was expected.
> 	at org.apache.avro.io.parsing.Parser.advance(Parser.java:93)
> 	at org.apache.avro.io.JsonEncoder.writeEnum(JsonEncoder.java:210)
> 	at org.apache.avro.specific.SpecificDatumWriter.writeEnum(SpecificDatumWriter.java:54)
> 	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:66)
> 	at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:104)
> 	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:65)
> 	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:57)
> 	at org.apache.hadoop.mapreduce.jobhistory.EventWriter.write(EventWriter.java:66)
> 	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler$MetaInfo.writeEvent(JobHistoryEventHandler.java:825)
> 	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.handleEvent(JobHistoryEventHandler.java:517)
> 	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.stop(JobHistoryEventHandler.java:346)
> 	at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:99)
> 	at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:445)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:406)
> 	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:126)
> 	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
> 	at java.lang.Thread.run(Thread.java:662)
> 2013-01-19 19:31:27,271 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.MRAppMaster:
Deleting staging directory hdfs://hacluster /root/staging-dir/root/.staging/job_1358603069474_0135
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message