giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rafal Wojdyla <...@spotify.com>
Subject Re: Giraph waiting infinitely
Date Wed, 04 Dec 2013 09:41:36 GMT
Hi!

I use Giraph trunk (1.1.0) with java 1.6 and hadoop 2.2.0.x  and I try to
run the example from http://giraph.apache.org/quick_start.html on the
example data from the page - I have the same problem. So I started this
issue: https://issues.apache.org/jira/browse/GIRAPH-806

Cheers - Rafal


On Tue, Dec 3, 2013 at 8:46 PM, Manuel Lagang <manuellagang@gmail.com>wrote:

> If you expected your job to take a while and you just want to make sure
> the job doesn't fail due to timeouts, you can set the hadoop parameter "
> mapreduce.task.timeout" to a higher value or to 0 for no timeouts at all.
>
> If you didn't expect your job to take a while on a single worker, it's
> hard to figure out what went wrong without more context on your code or
> what stage the job is failing (during input loading? which superstep?).
>
>
> On Tue, Dec 3, 2013 at 11:19 AM, Sundara Raghavan Sankaran <
> sundar@crayondata.com> wrote:
>
>> Hi,
>>
>> In my giraph job, one of the workers just outputs the same log repeatedly
>> and ultimately the job fails because of it not reporting its status.
>>
>> Here is the log:-
>>
>> 2013-12-03 19:01:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:01:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:02:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:02:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:03:01,159 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:03:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:04:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:04:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:05:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:05:01,160 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:06:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:06:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:07:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:07:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:08:01,161 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:08:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:09:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:09:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>> 2013-12-03 19:10:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Future result not ready yet
>> java.util.concurrent.FutureTask@4281de5c
>> 2013-12-03 19:10:01,162 INFO org.apache.giraph.utils.ProgressableUtils:
>> waitFor: Waiting for
>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20
>>
>> What is going on? Is there something I can do so that it doesn't happen.
>>
>>
>> --
>>
>> Thanks,
>>
>> Sundar
>>
>
>

Mime
View raw message