kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ismael Juma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log
Date Tue, 06 Jun 2017 13:05:18 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038844#comment-16038844

Ismael Juma commented on KAFKA-5390:

The errors show what the issue is. The segment size is too small for the record batch that
is being produced. The server correctly rejects the batch. 

> First records in batch rejected but others accepted when rolling log
> --------------------------------------------------------------------
>                 Key: KAFKA-5390
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5390
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions:
>            Reporter: Magnus Reftel
>         Attachments: kafka-sequence-2.tar.gz, kafka-sequence.tar.gz
> When sending a sequence of records in a batch right when the broker needs to roll a new
segment, it's possible for the first few records to fail, while other records in the batch
are accepted. If records have dependencies on earlier records, e.g. in the case of a sequence
of events in an event-sourced system, then a producer cannot use the batching functionality,
since it then risks consumers receiving a record without first receiving the records it depends
> See attached testcase (kafka-sequence.tar.gz).

This message was sent by Atlassian JIRA

View raw message