kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugen Feller (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-7405) Support for graceful handling of corrupted records in Kafka consumer
Date Wed, 12 Sep 2018 19:14:00 GMT
Eugen Feller created KAFKA-7405:
-----------------------------------

             Summary: Support for graceful handling of corrupted records in Kafka consumer
                 Key: KAFKA-7405
                 URL: https://issues.apache.org/jira/browse/KAFKA-7405
             Project: Kafka
          Issue Type: Improvement
          Components: consumer, streams
    Affects Versions: 1.1.1, 0.11.0.3, 0.10.2.2
            Reporter: Eugen Feller


We have run into issues several times where a corrupted records cause the Kafka consumer to
throw an error code 2 exception in the fetch layer that can not be handled gracefully.
Specifically, when using Kafka streams we run into KAFKA-6977 that throws an IllegalStateException.
It would be great if the Kafka consumer could be extended with a setting similar to [KIP-161|https://cwiki.apache.org/confluence/display/KAFKA/KIP-161%3A+streams+deserialization+exception+handlers], that
would allow one to cleanly ignore corrupted records.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message