kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ismael Juma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-3174) Re-evaluate the CRC32 class performance.
Date Tue, 04 Apr 2017 13:11:41 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955113#comment-15955113
] 

Ismael Juma commented on KAFKA-3174:
------------------------------------

We switched message format V2 to use CRC32C (see KAFKA-1449). It seems that the safest thing
is not to change what we do for V0 and V1.

> Re-evaluate the CRC32 class performance.
> ----------------------------------------
>
>                 Key: KAFKA-3174
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3174
>             Project: Kafka
>          Issue Type: Improvement
>    Affects Versions: 0.9.0.0
>            Reporter: Jiangjie Qin
>            Assignee: Jiangjie Qin
>
> We used org.apache.kafka.common.utils.CRC32 in clients because it has better performance
than java.util.zip.CRC32 in Java 1.6.
> In a recent test I ran it looks in Java 1.8 the CRC32 class is 2x as fast as the Crc32
class we are using now. We may want to re-evaluate the performance of Crc32 class and see
it makes sense to simply use java CRC32 instead.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message