kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias J. Sax (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-6454) Allow timestamp manipulation in Processor API
Date Wed, 31 Jan 2018 02:04:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias J. Sax updated KAFKA-6454:
-----------------------------------
    Description: 
Atm, Kafka Streams only has a defined "contract" about timestamp propagation at the Processor
API level: all processor within a sub-topology, see the timestamp from the input topic record
and this timestamp will be used for all result record when writing them to an topic, too.

For the DSL and also for custom operator, it would be desirable to allow timestamp manipulation
for at Processor level for individual records that are forwarded.

KIP-251: https://cwiki.apache.org/confluence/display/KAFKA/KIP-251%3A+Allow+timestamp+manipulation+in+Processor+API

  was:
Atm, Kafka Streams only has a defined "contract" about timestamp propagation at the Processor
API level: all processor within a sub-topology, see the timestamp from the input topic record
and this timestamp will be used for all result record when writing them to an topic, too.

For the DSL and also for custom operator, it would be desirable to allow timestamp manipulation
for at Processor level for individual records that are forwarded.


> Allow timestamp manipulation in Processor API
> ---------------------------------------------
>
>                 Key: KAFKA-6454
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6454
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>    Affects Versions: 1.0.0
>            Reporter: Matthias J. Sax
>            Assignee: Matthias J. Sax
>            Priority: Major
>              Labels: kip
>             Fix For: 1.2.0
>
>
> Atm, Kafka Streams only has a defined "contract" about timestamp propagation at the Processor
API level: all processor within a sub-topology, see the timestamp from the input topic record
and this timestamp will be used for all result record when writing them to an topic, too.
> For the DSL and also for custom operator, it would be desirable to allow timestamp manipulation
for at Processor level for individual records that are forwarded.
> KIP-251: https://cwiki.apache.org/confluence/display/KAFKA/KIP-251%3A+Allow+timestamp+manipulation+in+Processor+API



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message