giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maja Kabiljo (JIRA)" <j...@apache.org>
Subject [jira] [Created] (GIRAPH-998) Close writers in parallel
Date Thu, 19 Mar 2015 17:49:38 GMT
Maja Kabiljo created GIRAPH-998:
-----------------------------------

             Summary: Close writers in parallel
                 Key: GIRAPH-998
                 URL: https://issues.apache.org/jira/browse/GIRAPH-998
             Project: Giraph
          Issue Type: Improvement
            Reporter: Maja Kabiljo
            Assignee: Maja Kabiljo
            Priority: Minor


When thread-safe per superstep output is used, in the end of application we close all the
writers in a single thread. Closing a writer can take time, and we are not reporting progress
while doing so, so it happens that tasks timeout during this stage. Doing it in multiple threads
and calling progress while doing it will make it faster and prevent tasks from timing out.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message