giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nitay Joffe (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GIRAPH-390) MasterCompute end of application callback
Date Wed, 07 Nov 2012 19:18:12 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nitay Joffe updated GIRAPH-390:
-------------------------------

    Attachment: GIRAPH-390-2.patch
    
> MasterCompute end of application callback
> -----------------------------------------
>
>                 Key: GIRAPH-390
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-390
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Nitay Joffe
>            Assignee: Nitay Joffe
>         Attachments: GIRAPH-390-2.patch, GIRAPH-390.patch
>
>
> There is no way to run something on the master at the end of the application like in
WorkerContext. This adds a MasterObserver which gets called at the end of the job by the master.
The user can register as many MasterObservers as they like, allowing flexibility.
> I am using this to write the Hadoop counters to a database at the end of the job. As
a part of this I also cleaned up the logic around those counters and made them more easily
accessible by others.
> https://reviews.apache.org/r/7762/

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message