hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsuyoshi OZAWA (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5623) TestJobCleanup fails because of RejectedExecutionException and NPE.
Date Wed, 13 Nov 2013 11:44:24 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tsuyoshi OZAWA updated MAPREDUCE-5623:
--------------------------------------

    Description: org.apache.hadoop.mapred.TestJobCleanup can fail because of RejectedExecutionException
by NonAggregatingLogHandler. This problem is described in YARN-1409. TestJobCleanup can still
fail after fixing RejectedExecutionException, because of NPE by Job#getCounters()'s returning
null.  (was: This problem is caused by handling APPLICATION_FINISHED events after calling
sched.shotdown() in NonAggregatingLongHandler#serviceStop().

org.apache.hadoop.mapred.TestJobCleanup can fail because of RejectedExecutionException by
NonAggregatingLogHandler.

{code}
2013-11-13 10:53:06,970 FATAL [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(166))
- Error in dispatcher thread
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@d51df63
rejected from java.util.concurrent.ScheduledThreadPoolExecutor@7a20e369[Shutting down, pool
size = 4, active threads = 0, queued tasks = 7, completed tasks = 0]
        at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
        at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
        at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:325)
        at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:530)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler.handle(NonAggregatingLogHandler.java:121)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler.handle(NonAggregatingLogHandler.java:49)
        at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:159)
        at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:95)
        at java.lang.Thread.run(Thread.java:724)
{code}

TestJobCleanup can still fail after fixing this RejectedExecutionException, because of NPE
by Job#getCounters()'s returning null.)

> TestJobCleanup fails because of RejectedExecutionException and NPE.
> -------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5623
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5623
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Tsuyoshi OZAWA
>
> org.apache.hadoop.mapred.TestJobCleanup can fail because of RejectedExecutionException
by NonAggregatingLogHandler. This problem is described in YARN-1409. TestJobCleanup can still
fail after fixing RejectedExecutionException, because of NPE by Job#getCounters()'s returning
null.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message