kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maxime Brugidou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-845) Re-implement shallow iteration on 0.8.1
Date Wed, 03 Apr 2013 13:53:15 GMT
Maxime Brugidou created KAFKA-845:
-------------------------------------

             Summary: Re-implement shallow iteration on 0.8.1
                 Key: KAFKA-845
                 URL: https://issues.apache.org/jira/browse/KAFKA-845
             Project: Kafka
          Issue Type: Improvement
          Components: core
    Affects Versions: 0.8.1
            Reporter: Maxime Brugidou


After KAFKA-732 we decided to not support the shallow iteration feature to speed up the 0.8
release.

This severely impacts the performance for heavy mirroring between clusters. The MirrorMaker
needs to decompress/recompress the data which actually triple the CPU compression cost in
the data flow (initial compression + 2x compression for mirroring).

It would be great to discuss a solution to re-implement the feature correctly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message