giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-426) Timeout during edge exchange for big datasets
Date Sun, 18 Nov 2012 18:44:57 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499872#comment-13499872
] 

Eli Reisman commented on GIRAPH-426:
------------------------------------

The supernodes make life interesting, thats for sure. For appplications where trimming them
is not an option, this will be "real life" for Giraph. Its great that you are evaluating performance
and issues this way.
                
> Timeout during edge exchange for big datasets
> ---------------------------------------------
>
>                 Key: GIRAPH-426
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-426
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Alessandro Presta
>
> I'm seeing timeouts after all edge input splits are read from a dataset with 42B edges
using 400 workers.
> We probably lack some progress() calls in the code that processes mutations.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message