giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manuel Lagang <manuellag...@gmail.com>
Subject Re: Giraph waiting infinitely
Date Tue, 03 Dec 2013 19:46:17 GMT
If you expected your job to take a while and you just want to make sure the
job doesn't fail due to timeouts, you can set the hadoop parameter "
mapreduce.task.timeout" to a higher value or to 0 for no timeouts at all.

If you didn't expect your job to take a while on a single worker, it's hard
to figure out what went wrong without more context on your code or what
stage the job is failing (during input loading? which superstep?).


On Tue, Dec 3, 2013 at 11:19 AM, Sundara Raghavan Sankaran <
sundar@crayondata.com> wrote:

> Hi,
>
> In my giraph job, one of the workers just outputs the same log repeatedly
> and ultimately the job fails because of it not reporting its status.
>
> Here is the log:-
>
> 2013-12-03 19:01:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:01:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:02:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:02:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:03:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:03:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:04:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:04:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:05:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:05:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:06:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:06:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:07:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:07:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:08:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:08:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:09:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:09:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
> 2013-12-03 19:10:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Future result not ready yet
> java.util.concurrent.FutureTask@4281de5c
> 2013-12-03 19:10:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
> waitFor: Waiting for
> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>
> What is going on? Is there something I can do so that it doesn't happen.
>
>
> --
>
> Thanks,
>
> Sundar
>

Mime
View raw message