flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marco Villalobos <mvillalo...@beyond.ai>
Subject Timeseries aggregation with many IoT devices off of one Kafka topic.
Date Mon, 24 Feb 2020 20:23:47 GMT
I need to collect timeseries data from thousands of IoT devices. Each device has name, value,
and timestamp published to one Kafka topic.  The event time timestamps are in order only relation
with the individual device, but out of order with respect to other devices.

Is there a way to aggregate a 15 minute window of this in which each IoT devices gets aggregated
with its own event time?

I would deeply appreciate if somebody could guide me to an approach for solving this in Flink.

I wish there was a group chat for these type of problems.

Mime
View raw message