incubator-giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Avery Ching (Commented) (JIRA)" <>
Subject [jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep
Date Fri, 21 Oct 2011 17:12:33 GMT


Avery Ching commented on GIRAPH-47:

Claudio, great work!  Couple of thoughts.

1) Probably rename DumbWorkerContext to something like a bit more PC, i.e. UnusedWorkerContext.

2) Could you remove the pre/post/Application/Superstep() code so we only have your way available?
 If you start by removing the 

public void preApplication()
public void postApplication()
public void preSuperstep()
public void postSuperstep()

methods from class Vertex, that should pretty much force you to fix everything else.  Then
once it passes unittests, please resubmit.

3) Checkpointing is an interesting idea, but my guess is out of the scope of this issue. 
In the case of emitting to HDFS, I don't think it'll do what you expect since HDFS files are

> Export Worker's Context/State to vertices through pre/post/Application/Superstep
> --------------------------------------------------------------------------------
>                 Key: GIRAPH-47
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>          Components: graph
>    Affects Versions: 0.70.0
>            Reporter: Claudio Martella
>            Assignee: Claudio Martella
>         Attachments: GIRAPH-47.diff
> It would be quite useful for vertices to reach some worker-related information stored
i.e. in the GraphState class.
> This information could be exported as a parameter to pre/post/Application/Superstep like
> public void preApplication(Configurable workerObject);
> public void postApplication(Configurable workerObject);
> public void preSuperstep(Configurable workerObject);
> public void postSuperstep(Configurable workerObject);
> public Configurable getWorkerObject();
> Another possibility is to add a Context inner class to BasicVertex to store this information.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message