kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guozhang Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-1253) Implement compression in new producer
Date Tue, 18 Mar 2014 18:21:43 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939579#comment-13939579
] 

Guozhang Wang commented on KAFKA-1253:
--------------------------------------

The first experiments are done with 10K messages half of which are random bits and the other
half all 1's, batch size = 16K, recorded #.reallocations.

GZIP:

|| message size || 1K || 10K || 100K ||
|heuristic0|1|0|0|
|heuristic1|0|0|0|
|heuristic2|0|0|0|
|heuristic3|0|0|0|
|heuristic4|1|2400|0|

SNAPPY:

|| message size || 1K || 10K || 100K ||
|heuristic0|0|0|0|
|heuristic1|0|0|0|
|heuristic2|0|0|0|
|heuristic3|0|0|0|
|heuristic4|0|0|0|

> Implement compression in new producer
> -------------------------------------
>
>                 Key: KAFKA-1253
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1253
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: producer 
>            Reporter: Jay Kreps
>            Assignee: Guozhang Wang
>         Attachments: KAFKA-1253.patch, KAFKA-1253_2014-02-21_16:15:21.patch, KAFKA-1253_2014-02-21_17:55:52.patch,
KAFKA-1253_2014-02-24_13:31:50.patch, KAFKA-1253_2014-02-26_17:31:30.patch, KAFKA-1253_2014-03-06_17:48:11.patch,
KAFKA-1253_2014-03-07_16:34:33.patch, KAFKA-1253_2014-03-10_14:35:56.patch, KAFKA-1253_2014-03-10_14:39:58.patch,
KAFKA-1253_2014-03-10_15:27:47.patch, KAFKA-1253_2014-03-14_13:46:40.patch, KAFKA-1253_2014-03-14_17:39:53.patch,
KAFKA-1253_2014-03-17_15:56:04.patch, compression-fix.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message