flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Juan Rodríguez Hortalá <juan.rodriguez.hort...@gmail.com>
Subject Testing DataStreams
Date Wed, 02 Nov 2016 15:58:09 GMT
Hi,

I'm new to Flink, and I'm trying to write my first unit test  for a simple
DataStreams job. In
https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/streaming/util/package-summary.html
I see several promising classes, but for example I cannot import
org.apache.flink.streaming.util.StreamingMultipleProgramsTestBase from the
artifacts obtained by the following Maven dependencies:

         <dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-java</artifactId>
            <version>${flink.version}</version>
        </dependency>
        <dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-streaming-java_2.10</artifactId>
            <version>${flink.version}</version>
        </dependency>
        <dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-clients_2.10</artifactId>
            <version>${flink.version}</version>
        </dependency>

I also see that the page
https://cwiki.apache.org/confluence/display/FLINK/Testing+Utilities+and+Mini+Clusters
is empty. Is there any documentation or tutorial about writing simple unit
tests running in local mode? I'm looking for something similar to
http://blog.cloudera.com/blog/2015/09/making-apache-spark-testing-easy-with-spark-testing-base/,
where you can specify the expected output as a collection to define an
assertion, but for Flink.

By the way I have also implemented source function similar to
StreamExecutionEnvironment.fromElements but that allows to add time gaps
between the generated elements, that I think could be useful for testing,
in case someone is interested
https://github.com/juanrh/flink-state-eviction/blob/master/src/main/java/com/github/juanrh/streaming/source/ElementsWithGapsSource.java.


Thanks,

Juan

Mime
View raw message