giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maja Kabiljo (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GIRAPH-600) Create an option to do output during computation
Date Fri, 29 Mar 2013 01:47:15 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Maja Kabiljo updated GIRAPH-600:
--------------------------------

    Attachment: GIRAPH-600.patch

When default settings are used everything is as it used to be, tweaking the settings allows
us to have output right after the compute and to choose whether our output format can handle
multiple writers at the same time, or we have to synchronize when writing.
This doesn't work well with checkpointing, as I noted in one comment, we can work on that
later.
Passes mvn verify, yet to try it with the real application.
                
> Create an option to do output during computation
> ------------------------------------------------
>
>                 Key: GIRAPH-600
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-600
>             Project: Giraph
>          Issue Type: New Feature
>            Reporter: Maja Kabiljo
>            Assignee: Maja Kabiljo
>         Attachments: GIRAPH-600.patch
>
>
> In some of our applications, we get some partial results during the computation, which
we are not able to keep around until the end of the job.
> It would be good to add an option to write vertices to output during computation instead
of doing it in the end of the application. 
> This is the first step, in the future we might want to allow both outputs, or outputs
only in some supersteps, or having different output per superstep, and so on.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message