reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julia (JIRA)" <j...@apache.org>
Subject [jira] [Created] (REEF-1493) Handle exception from IIMRUResultHandler.Dispose()
Date Wed, 13 Jul 2016 19:35:21 GMT
Julia created REEF-1493:
---------------------------

             Summary: Handle exception from IIMRUResultHandler.Dispose()
                 Key: REEF-1493
                 URL: https://issues.apache.org/jira/browse/REEF-1493
             Project: REEF
          Issue Type: Bug
            Reporter: Julia


Currently, in UpdateHost, before task exits, we  call _resultHandler.Dispose(), It can throw
exception depend on the implementation of the IIMRUResultHandler. 
In FaultTolerant scenario, if other mappers have completed/closed before this method is called
in master, the exception does happen in testing, e.g. in WriteResultHandler.Dispose(). We
need to have a proper way to handle the exception. 
If it is caused by group communication, we can simply throw IMRUTaskGroupCommunicationException,
so that it only fails at task and still can be recovered. 
If it is resource leak, we might want to fail Evaluator. Since it is master, that means, the
system will not be recoverable. 
Also Dispose should only release resources. If we want to do something in master before exit,
it may need to be in a separate method instead of Dispose. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message