flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Tiny topology shows '0' for all stats.
Date Mon, 14 Dec 2015 16:58:16 GMT
To sum this up, the web dashboard stats are Flink network stats. If you job
has no network communication, its all zero.

On Mon, Dec 14, 2015 at 5:03 PM, Ufuk Celebi <uce@apache.org> wrote:

>
> > On 14 Dec 2015, at 16:25, Niels Basjes <Niels@basjes.nl> wrote:
> >
> > Hi,
> >
> > I have a very small topology here.
> > In fact this is a thing that generates synthetic data and puts it into
> Kafka.
> > When looking at the web UI I see that all counters (i.e. Bytes received,
> Records received, Bytes sent,  Records sent) all remain 0.
> > I verified and I'm seeing thousands of records arriving into Kafka.
> >
> > Is this a bug in Flink or am I misinterpreting the meaning of these
> numbers?
>
> Sources and sinks do not show the number of received or sent records,
> because of the internals of how these numbers are collected. I agree that
> this is confusing. Big +1 to improve this.
>
> You actually don’t see any numbers, because the operators are chained and
> hence you only have one task, which acts as both source and sink.
>
> You should see some sent and received numbers if you break up the chain
> (env.disableOperatorChaining()). Can you confirm this?
>
> – Ufuk
>
>

Mime
View raw message