kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexander Koval (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6396) Possibly kafka-connect converter should be able to stop processing chain
Date Thu, 21 Dec 2017 16:16:00 GMT
Alexander Koval created KAFKA-6396:

             Summary: Possibly kafka-connect converter should be able to stop processing chain
                 Key: KAFKA-6396
                 URL: https://issues.apache.org/jira/browse/KAFKA-6396
             Project: Kafka
          Issue Type: Wish
          Components: KafkaConnect
    Affects Versions: 1.0.0
            Reporter: Alexander Koval
            Priority: Minor

At present only transformations can discard records returning null. But I think sometimes
it would be nice to discard processing chain after converting message. For example I have
some tags shipped with a message key and I want to stop processing the message after converting
its key (there are a lot of messages and I don't want to deserialize message values that I
don't need).

At the moment to do that I should disable converters and move message deserializing to the
transformation chain:



If [WorkerSinkTask|https://github.com/apache/kafka/blob/1.0.0/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerSinkTask.java#L453]
checked converted values on {{null}} it would solved my problem more gracefully

This message was sent by Atlassian JIRA

View raw message