incubator-s4-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthieu Morel (JIRA)" <>
Subject [jira] [Created] (S4-87) Checkpointing: recovery : avoid rejections upon fetching
Date Mon, 23 Jul 2012 17:35:36 GMT
Matthieu Morel created S4-87:

             Summary: Checkpointing: recovery : avoid rejections upon fetching
                 Key: S4-87
             Project: Apache S4
          Issue Type: Bug
    Affects Versions: 0.5
            Reporter: Matthieu Morel

Tests pass fine on macosx with jdk 1.6.0_33 but fail on ubuntu with the same jdk version (oracle).

Here is the stacktrace: (I added some logging to see the error)
java.util.concurrent.RejectedExecutionException: null
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(
	at java.util.concurrent.ThreadPoolExecutor.reject( ~[na:1.6.0_33]
	at java.util.concurrent.ThreadPoolExecutor.execute( ~[na:1.6.0_33]
	at java.util.concurrent.AbstractExecutorService.submit( ~[na:1.6.0_33]
	at org.apache.s4.core.ft.SafeKeeper.fetchSerializedState( ~[main/:na]
	at org.apache.s4.core.ProcessingElement.recover( [main/:na]
	at org.apache.s4.core.ProcessingElement.handleInputEvent( [main/:na]
	at [main/:na]
	at [na:1.6.0_33]
 [words seen stream] ERROR org.apache.s4.core.ProcessingElement - Cannot fetch serialized
stated for [org.apache.s4.wordcount.WordCounterPE/doobie

This could be due to the fact that we use a handoff queue, though it is not clear to me.

Anyway, since there may be parallel recovery request from different prototypes, it may be
more adequate to use a bounded queue, with the possibility to use multiple threads for the
fetch operations.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message