kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "fengchaoli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5831) MemoryRecordsBuilder uses small compression buffer leading to snappy low compression ratio
Date Mon, 04 Sep 2017 11:47:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152509#comment-16152509
] 

fengchaoli commented on KAFKA-5831:
-----------------------------------

In my test case
use 1K buffer , 18% compression ration
use 32K buffer, 39% compression ration

> MemoryRecordsBuilder uses small compression buffer leading to snappy low  compression
ratio 
> --------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-5831
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5831
>             Project: Kafka
>          Issue Type: Improvement
>          Components: clients
>    Affects Versions: 0.10.0.0, 0.10.2.0, 0.10.2.1
>         Environment: kafka-0.10.2.1
>            Reporter: fengchaoli
>
> MemoryRecordsBuilder creates 'SnappyOutputStream' with  1K compression buffer  ( SnappyOutputStream
default is 32K), which causes snappy compression ratio very lower.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message