giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maja Kabiljo (JIRA)" <j...@apache.org>
Subject [jira] [Created] (GIRAPH-1036) Allow mappers to fail early on exceptions
Date Wed, 21 Oct 2015 01:19:27 GMT
Maja Kabiljo created GIRAPH-1036:
------------------------------------

             Summary: Allow mappers to fail early on exceptions
                 Key: GIRAPH-1036
                 URL: https://issues.apache.org/jira/browse/GIRAPH-1036
             Project: Giraph
          Issue Type: Bug
            Reporter: Maja Kabiljo
            Assignee: Maja Kabiljo


Often when something fails in a mapper we see it stuck until its timeout passes. Digging through
this issue I found two root causes:
- Many threads we are creating were not daemon, preventing process to exit, only main thread
should be daemon
- When calling submit on ExecutorService, exceptions are not propagated back to the caller,
unless get is called on the future. In ProgressableUtils.getResultsWithNCallables we were
calling get on one by one future, causing us to have to wait for previous futures to finish
before getting exception which happened in later one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message