giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Edunov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-998) Close writers in parallel
Date Tue, 24 Mar 2015 22:42:53 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378817#comment-14378817
] 

Sergey Edunov commented on GIRAPH-998:
--------------------------------------

+1 lgtm

> Close writers in parallel
> -------------------------
>
>                 Key: GIRAPH-998
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-998
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Maja Kabiljo
>            Assignee: Maja Kabiljo
>            Priority: Minor
>         Attachments: GIRAPH-998.patch
>
>
> When thread-safe per superstep output is used, in the end of application we close all
the writers in a single thread. Closing a writer can take time, and we are not reporting progress
while doing so, so it happens that tasks timeout during this stage. Doing it in multiple threads
and calling progress while doing it will make it faster and prevent tasks from timing out.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message