hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suraj Menon (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HAMA-700) BSPPartitioner should be configurable to be optional and allow input format conversion
Date Sat, 15 Dec 2012 22:22:12 GMT

    [ https://issues.apache.org/jira/browse/HAMA-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13533175#comment-13533175
] 

Suraj Menon edited comment on HAMA-700 at 12/15/12 10:21 PM:
-------------------------------------------------------------

This patch is just an implementation of the idea to convert the raw input format to the processing
input format. This would be essential especially when we start integrating with HBase, Accumulo.
Please vote on the idea. I would like to continue on the patch. I feel Thomas had some genuine
concerns. We can use the VertexInputReader defined in the examples as they were and we can
do runtime partitioning of graph in the PartitionRunner. The patch compiles but not yet tested
for unit tests.
                
      was (Author: surajsmenon):
    This patch is just an implementation of the idea to convert the raw input format to the
processing input format. This would be essential especially when we start integrating with
HBase, Accumulo. Please vote on the idea. I would like to continue on the patch. I feel Thomas
had some genuine concerns. We can use the VertexInputReader defined in the examples as they
were and we can do runtime partitioning of graph in the PartitionRunner.
                  
> BSPPartitioner should be configurable to be optional and allow input format conversion
> --------------------------------------------------------------------------------------
>
>                 Key: HAMA-700
>                 URL: https://issues.apache.org/jira/browse/HAMA-700
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp core
>            Reporter: Suraj Menon
>            Assignee: Suraj Menon
>             Fix For: 0.6.1
>
>         Attachments: HAMA-700-v1.patch
>
>
> There should be a provisioning for skipping the PartitionRunner if needed. Also we can
have a RecordConverter interface so that the PartitionRunner can read the input in any format
and create new splits. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message