kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Gustafson (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6530) Use actual first offset of messages when rolling log segment for magic v2
Date Sat, 03 Feb 2018 07:26:00 GMT
Jason Gustafson created KAFKA-6530:
--------------------------------------

             Summary: Use actual first offset of messages when rolling log segment for magic
v2
                 Key: KAFKA-6530
                 URL: https://issues.apache.org/jira/browse/KAFKA-6530
             Project: Kafka
          Issue Type: Bug
            Reporter: Jason Gustafson


We've implemented a heuristic to avoid overflowing when rolling a log segment to determine
the base offset of the next segment without decompressing the message set to find the actual
first offset. With the v2 message format, we can find the first offset without needing decompression,
so we can set the correct base offset exactly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message