giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maja Kabiljo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-513) OnDiskPartitionStore should take advantage of multiple disks
Date Wed, 13 Feb 2013 18:00:17 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13577779#comment-13577779
] 

Maja Kabiljo commented on GIRAPH-513:
-------------------------------------

With messages we also have one file per partition (one SequentialFileMessageStore per partition)
so it should be similar.

Regarding the patch, be careful that Math.abs can return negative value for Integer.MIN_VALUE.
To be safe, you can do a mod operation first, and then take Math.abs.
                
> OnDiskPartitionStore should take advantage of multiple disks
> ------------------------------------------------------------
>
>                 Key: GIRAPH-513
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-513
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Claudio Martella
>            Assignee: Claudio Martella
>            Priority: Minor
>         Attachments: GIRAPH-513.diff
>
>
> Currently multiple compute threads can share the same OnDiskPartitionStore, but we do
not take advantage of machines with multiple disks. We should partition the Partitions across
the different disks, mimicking the way DataNodes take advantage of multiple disks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message