flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gyula Fóra <gyula.f...@gmail.com>
Subject Re: Kafka source stuck while canceling
Date Thu, 22 Oct 2015 06:15:33 GMT
I don't think I have the logs for that run anymore, I wasn't smart enough
to save it.

If I encounter it again I will try to get more info.

Thanks,
Gyula

Stephan Ewen <sewen@apache.org> ezt írta (időpont: 2015. okt. 21., Sze,
19:04):

> The Kafka consumer API has issue with being interruptible that will
> hopefully get better in Kafka 0.8.3.
>
> There must be another issue here in addition, though. Does the stacktrace
> go any deeper than that?
> I would assume that the main invokable thread is stuck in some blocking
> method, or in a loop that does not terminate. It might also be stuck on a
> lock, in which case it would be waiting for the lock holder to terminate.
>
> Do you have the traces from other threads as well, so we could look which
> one actually is stuck while holding the lock?
>
> Greetings,
> Stephan
>
>
> On Mon, Oct 19, 2015 at 12:06 PM, Gyula Fóra <gyula.fora@gmail.com> wrote:
>
> > Hey guys,
> >
> > Has anyone ever got something similar working with the kafka sources?
> >
> > 11:52:48,838 WARN  org.apache.flink.runtime.taskmanager.Task
> >       - Task 'Source: Kafka[***] (3/4)' did not react to cancelling
> signal,
> > but is stuck in method:
> >
> >
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:208)
> > org.apache.flink.runtime.taskmanager.Task.run(Task.java:584)
> > java.lang.Thread.run(Thread.java:745)
> >
> > The failure was caused by a different operator in the pipeline, but the
> job
> > could never be fully cancelled and restarted due to this error.
> >
> > Any idea is appreciated :)
> >
> > Cheers,
> > Gyula
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message