kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jun Rao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-598) decouple fetch size from max message size
Date Thu, 01 Nov 2012 15:37:14 GMT
Jun Rao created KAFKA-598:

             Summary: decouple fetch size from max message size
                 Key: KAFKA-598
                 URL: https://issues.apache.org/jira/browse/KAFKA-598
             Project: Kafka
          Issue Type: Bug
          Components: core
    Affects Versions: 0.8
            Reporter: Jun Rao

Currently, a consumer has to set fetch size larger than the max message size. This increases
the memory footprint on the consumer, especially when a large number of topic/partition is
subscribed. By decoupling the fetch size from max message size, we can use a smaller fetch
size for normal consumption and when hitting a large message (hopefully rare), we automatically
increase fetch size to max message size temporarily.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message