giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-473) InputSplitPathOrganizer should be aware of multiple threads
Date Thu, 10 Jan 2013 18:42:13 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13549889#comment-13549889
] 

Eli Reisman commented on GIRAPH-473:
------------------------------------

I will double check, there was something about that test and the ordering that was important,
but it might be as simple as making sure "good" is first. Perhaps adding the threadID to the
hash mixed up the other two but it may not matter as you said. I'll patch this onto trunk
in a minute and take a look.
                
> InputSplitPathOrganizer should be aware of multiple threads
> -----------------------------------------------------------
>
>                 Key: GIRAPH-473
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-473
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Alessandro Presta
>            Assignee: Alessandro Presta
>            Priority: Minor
>         Attachments: GIRAPH-473.patch
>
>
> The starting offset for iterating over input splits is obtained by hashing the worker's
hostname and port. When multiple input threads are used, they get the same offset.
> We should hash the thread id as well.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message