flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aljoscha Krettek (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-6323) Add new Sink interface with access to more meta data
Date Tue, 18 Apr 2017 15:55:41 GMT
Aljoscha Krettek created FLINK-6323:

             Summary: Add new Sink interface with access to more meta data
                 Key: FLINK-6323
                 URL: https://issues.apache.org/jira/browse/FLINK-6323
             Project: Flink
          Issue Type: Improvement
          Components: DataStream API
            Reporter: Aljoscha Krettek

The current {{SinkFunction}} cannot access the timestamps of elements which resulted in the
(somewhat hacky) {{FlinkKafkaProducer010}}. Due to other limitations {{GenericWriteAheadSink}}
is currently also a {{StreamOperator}} and not a {{SinkFunction}}.

We should add a new interface for sinks that takes a context parameter, similar to {{ProcessFunction}}.
This will allow sinks to query additional meta data about the element that they're receiving.

This is one ML thread where a user ran into a problem caused by this: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Why-I-am-getting-Null-pointer-exception-while-accessing-RuntimeContext-in-FlinkKafkaProducer010-td12633.html#a12635

This message was sent by Atlassian JIRA

View raw message