flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3133) Introduce collect()/coun()/print() methods in DataStream API
Date Mon, 07 Dec 2015 15:47:11 GMT
Maximilian Michels created FLINK-3133:

             Summary: Introduce collect()/coun()/print() methods in DataStream API
                 Key: FLINK-3133
                 URL: https://issues.apache.org/jira/browse/FLINK-3133
             Project: Flink
          Issue Type: Improvement
          Components: DataStream API, Streaming
    Affects Versions: 0.10.1, 0.10.0, 1.0.0
            Reporter: Maximilian Michels
             Fix For: 1.0.0

The DataSet API's methods {{collect()}}, {{count()}}, and {{print()}} should be mirrored to
the DataStream API. 

The semantics of the calls are different. We need to be able to sample parts of a stream,
e.g. by supplying a time period in the arguments to the methods. Collect/count/print should
be lazily evaluated. Users should use the {{StreamEnvironment}} to retrieve the results.

StreamExecutionEnvironment env = StramEnvironment.getStreamExecutionEnvironment();

DataStream<Integer> printSink = env.addSource(..).print();

ResultQueryable queryObject = env.executeWithResultQueryable();

List<Integer> sampled = queryObject.retrieve(printSink, Time.seconds(5));

This message was sent by Atlassian JIRA

View raw message