giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nitay Joffe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-732) EdgeOutputFormat
Date Thu, 08 Aug 2013 13:40:49 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13733492#comment-13733492
] 

Nitay Joffe commented on GIRAPH-732:
------------------------------------

Yes both (1) and (2) are possible.
(1) should be easy enough by just putting VertexOutputFormat logic before EdgeOutputFormat.
For (2) you can use some ZK nodes to synchronize across all the workers. You will probably
have to call the committer methods yourself. Take a look at how we do per-superstep output
for help.

For your use case, to print the outgoing edges for a given vertex X, do you just need X's
data to have been written, or do you need all vertices data to have already been written?
If it's the former than you can do what you want with existing code, for the latter you will
definitely need this new API we're talking about. 
                
> EdgeOutputFormat
> ----------------
>
>                 Key: GIRAPH-732
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-732
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Nitay Joffe
>
> Outputting edges is as easy as looping through edges in a vertex and writing them out.
However right now the user still needs to write a VertexOutputFormat and do it themselves.
> We should make this easier for them by adding an EdgeOutputFormat API and allowing the
user to specify a VertexOutputFormat and/or an EdgeOutputFormat.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message