kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apurva Mehta (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-4935) Disable record level crc checks on the consumer with the KIP-98 message format
Date Wed, 22 Mar 2017 17:49:41 GMT
Apurva Mehta created KAFKA-4935:
-----------------------------------

             Summary: Disable record level crc checks on the consumer with the KIP-98 message
format
                 Key: KAFKA-4935
                 URL: https://issues.apache.org/jira/browse/KAFKA-4935
             Project: Kafka
          Issue Type: Bug
            Reporter: Apurva Mehta


With the new message format proposed in KIP-98, the record level CRC has been moved to the
the batch header. The consumer record API still allows retrieval of CRC per record, and in
this case we compute the CRC on the fly. This degrades performance, and also such a computation
becomes unnecessary with the batch level CRC.

We can address this by deprecating the record level CRC api. We can also work around this
by disabling record level checks when the check crc config is set to false.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message