kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Palino (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6559) Iterate record sets before calling Log.append
Date Tue, 13 Feb 2018 18:48:00 GMT
Todd Palino created KAFKA-6559:

             Summary: Iterate record sets before calling Log.append
                 Key: KAFKA-6559
                 URL: https://issues.apache.org/jira/browse/KAFKA-6559
             Project: Kafka
          Issue Type: Improvement
          Components: core
    Affects Versions: 1.0.0
            Reporter: Todd Palino
            Assignee: Todd Palino

If a Produce request contains multiple record sets for a single topic-partition, it is better
to iterate these before calling Log.append. This is because append will process all the sets
together, and therefore will need to reassign offsets even if the offsets for an individual
record set are properly formed. By iterating the record sets before calling append, each set
can be considered on its own and potentially be appended without reassigning offsets.

While the core Java producer client does not current operate this way, it is permitted by
the protocol and may be used by other clients that aggregate multiple batches together to
produce them.

This message was sent by Atlassian JIRA

View raw message