kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jun Rao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-598) decouple fetch size from max message size
Date Thu, 01 Nov 2012 15:37:14 GMT
Jun Rao created KAFKA-598:
-----------------------------

             Summary: decouple fetch size from max message size
                 Key: KAFKA-598
                 URL: https://issues.apache.org/jira/browse/KAFKA-598
             Project: Kafka
          Issue Type: Bug
          Components: core
    Affects Versions: 0.8
            Reporter: Jun Rao


Currently, a consumer has to set fetch size larger than the max message size. This increases
the memory footprint on the consumer, especially when a large number of topic/partition is
subscribed. By decoupling the fetch size from max message size, we can use a smaller fetch
size for normal consumption and when hitting a large message (hopefully rare), we automatically
increase fetch size to max message size temporarily.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message