kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srinivas Dhruvakumar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-4430) Broker logging Topic and partition to exceptions: [topic,6] -> kafka.common.MessageSizeTooLargeException
Date Tue, 22 Nov 2016 02:20:58 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-4430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Srinivas Dhruvakumar updated KAFKA-4430:
----------------------------------------
    Description: 
I have a setup as below 
DC Kafka 
Mirrormaker 
Aggregate Kafka
Here is the following settings. I have set the max.message.bytes to 1 M on DC and AGG kafka.
Mirrormaker producer batch setting is set to 500 KBytes and max.request.size is set to 1 M
Byte and ack -> 0 and compression-> gzip . 
However on the Aggregate Kafka I get the following exception 

Closing connection due to error during produce request with correlation id 414156659 from
client id producer-1 with ack=0
KafkaServer.log.3:Topic and partition to exceptions: [topic1,6] -> kafka.common.MessageSizeTooLargeException

Is this a bug or why would this happen. Noticed that this happens in the Kafka API class.
I have configured mirrormaker to send messages less than 1 M Bytes




  was:
I have a setup as below 
DC Kafka 
Mirrormaker 
AGG Kafka
Here is the following settings. I have set the max.message.bytes to 1 M on DC and AGG kafka.
Mirrormaker producer batch setting is set to 500 KBytes and max.request.size is set to 1 M
Byte and ack -> 0. 
However on the AGG Kafka I get the following exception 
Closing connection due to error during produce request with correlation id 414156659 from
client id producer-1 with ack=0
KafkaServer.log.3:Topic and partition to exceptions: [topic1,6] -> kafka.common.MessageSizeTooLargeException

Is this a bug or why would this happen. Noticed that this happens in the Kafka API class.






> Broker logging Topic and partition to exceptions: [topic,6] -> kafka.common.MessageSizeTooLargeException
> --------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-4430
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4430
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.9.0.1
>         Environment: Production 
>            Reporter: Srinivas Dhruvakumar
>            Priority: Minor
>              Labels: newbie
>
> I have a setup as below 
> DC Kafka 
> Mirrormaker 
> Aggregate Kafka
> Here is the following settings. I have set the max.message.bytes to 1 M on DC and AGG
kafka. Mirrormaker producer batch setting is set to 500 KBytes and max.request.size is set
to 1 M Byte and ack -> 0 and compression-> gzip . 
> However on the Aggregate Kafka I get the following exception 
> Closing connection due to error during produce request with correlation id 414156659
from client id producer-1 with ack=0
> KafkaServer.log.3:Topic and partition to exceptions: [topic1,6] -> kafka.common.MessageSizeTooLargeException
> Is this a bug or why would this happen. Noticed that this happens in the Kafka API class.
I have configured mirrormaker to send messages less than 1 M Bytes



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message