flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charlie Moad <charlie.m...@geofeedia.com>
Subject Cross product of datastream and dataset
Date Thu, 17 Nov 2016 21:36:04 GMT
We're having trouble mapping our problem to Flink.

- For each incoming item
- Generate tuples of the item crossed with a data set
- Filter the tuples based on a condition
- Know the count of matching tuples

This seems to be mashup of DataStream and DataSet, but it appears you can't
operate with those together. We are also wondering if kicking off a batch
job for each incoming item is a feasible approach. We don't have time
window constraints.

Any recommendations would be greatly appreciated.

- Charlie

View raw message