flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ken Krugler <kkrugler_li...@transpac.com>
Subject Testing iterative data flows
Date Wed, 26 Oct 2016 21:10:32 GMT
Hi all,

What’s the recommended way currently to test a streaming data flow that has iterations?

I know that using timeouts in tests (which FLINK-2390 <https://issues.apache.org/jira/browse/FLINK-2390>
also discusses) isn’t reliable, and it’s hard to know when a job with iterations is really
“done” in the context of a test.

Are there any other approaches with current versions of Flink that would be better than an
arbitrary timeout?

Thanks,

— Ken

--------------------------
Ken Krugler
+1 530-210-6378
http://www.scaleunlimited.com
custom big data solutions & training
Hadoop, Cascading, Cassandra & Solr


Mime
View raw message