giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maja Kabiljo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-292) Computation progress is not being logged
Date Mon, 13 Aug 2012 20:02:38 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433475#comment-13433475
] 

Maja Kabiljo commented on GIRAPH-292:
-------------------------------------

Eli, I see the output like this when running bigger jobs:
{code}
INFO org.apache.giraph.graph.GraphMapper: map: Completed 1 of 10 partitions totalMem = 444.1875M,
maxMem = 444.5M, freeMem = 131.15521M
{code}
I usually see it for just a few partitions, so sometimes I decrease the time between writes
(GraphMapper:595) to see it for all.

The thing you are mentioning is BspServiceWorker:475-487. We can easily do the same thing
here, maybe make configurable how often the status is updated.
                
> Computation progress is not being logged
> ----------------------------------------
>
>                 Key: GIRAPH-292
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-292
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Alessandro Presta
>
> For better understanding long-running jobs, we need a way to log the progress of computations
during a superstep.
> Looking at GraphMapper, I noticed we have a TimedLogger that's supposed to do just that
(with a 15 seconds frequency), but I don't see its output.
> Can you guys confirm the issue?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message