giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sai Ganesh Muthuraman" <saiganesh...@gmail.com>
Subject Re: RELATION BETWEEN THE NUMBER OF GIRAPH WORKERS AND THE PROBLEM SIZE
Date Mon, 27 Feb 2017 15:27:56 GMT
Hi,

The first container in the application logs usually contains the gam logs. But the first container
logs are not available. Hence no gam logs.  What could be the possible reasons for the dying
of some workers?

Sai Ganesh

On Feb 25, 2017, at 9:30 PM, José Luis Larroque <user@giraph.apache.org> wrote:

You are probably looking at your giraph application manager (gam) logs. You should look for
your workers logs, each one have a log (container's logs). If you can't find them, you should
look at your yarn configuration in order to know where are them, see this: [http://stackoverflow.com/questions/21621755/where-does-hadoop-store-the-logs-of-yarn-applications](http://stackoverflow.com/questions/21621755/where-does-hadoop-store-the-logs-of-yarn-applications).

I don't recommend you to enable checkpointing until you now the specific error that you are
facing. If you are facing out of memory errors for example, checkpointing won't be helpful
in my experience, the same error will happen over and over.

--  **José
Mime
View raw message