kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ewen Cheslack-Postava (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-4005) Add per topic compression ratio in broker and consumer.
Date Mon, 16 Jan 2017 07:13:26 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15823556#comment-15823556

Ewen Cheslack-Postava commented on KAFKA-4005:

I agree this would be useful, but moving out of the target versions since we haven't had any
sort of PR for a couple of versions -- let's move it back in to a target version when we have
a real solution.

> Add per topic compression ratio in broker and consumer.
> -------------------------------------------------------
>                 Key: KAFKA-4005
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4005
>             Project: Kafka
>          Issue Type: Improvement
>          Components: clients, core
>            Reporter: Jiangjie Qin
>            Assignee: Jiangjie Qin
> Currently we only have compression ratio metric on the producer side. It would be very
useful to have that in the brokers and consumers for each topic as well. 
> On the broker side, the compression ratio can be potentially depending on the produce
request or the final message written to the disk. It is probably more useful to use the compression
ratio of the messages we finally writes to disk. If the messages are compressed in different
compression type, we can maintain the compression ratio for each type separately.
> The consumer side compression ratio would be for each topic and compression type combination
as well.

This message was sent by Atlassian JIRA

View raw message