Return-Path: <dev-return-69407-archive-asf-public=cust-asf.ponee.io@kafka.apache.org>
X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io
Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io
Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183])
	by cust-asf2.ponee.io (Postfix) with ESMTP id A4B46200BEF
	for <archive-asf-public-internal@cust-asf2.ponee.io>; Wed,  4 Jan 2017 11:39:00 +0100 (CET)
Received: by cust-asf.ponee.io (Postfix)
	id A1AAA160B44; Wed,  4 Jan 2017 10:39:00 +0000 (UTC)
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by cust-asf.ponee.io (Postfix) with SMTP id EAB02160B39
	for <archive-asf-public@cust-asf.ponee.io>; Wed,  4 Jan 2017 11:38:59 +0100 (CET)
Received: (qmail 46576 invoked by uid 500); 4 Jan 2017 10:38:58 -0000
Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@kafka.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@kafka.apache.org>
List-Post: <mailto:dev@kafka.apache.org>
List-Id: <dev.kafka.apache.org>
Reply-To: dev@kafka.apache.org
Delivered-To: mailing list dev@kafka.apache.org
Received: (qmail 46543 invoked by uid 99); 4 Jan 2017 10:38:58 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Jan 2017 10:38:58 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id 6F18C2C03DE
	for <dev@kafka.apache.org>; Wed,  4 Jan 2017 10:38:58 +0000 (UTC)
Date: Wed, 4 Jan 2017 10:38:58 +0000 (UTC)
From: "Ismael Juma (JIRA)" <jira@apache.org>
To: dev@kafka.apache.org
Message-ID: <JIRA.13029163.1482160033000.637664.1483526338453@Atlassian.JIRA>
In-Reply-To: <JIRA.13029163.1482160033000@Atlassian.JIRA>
References: <JIRA.13029163.1482160033000@Atlassian.JIRA> <JIRA.13029163.1482160033195@arcas>
Subject: [jira] [Updated] (KAFKA-4557) ConcurrentModificationException in
 KafkaProducer event loop
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
archived-at: Wed, 04 Jan 2017 10:39:00 -0000


     [ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ismael Juma updated KAFKA-4557:
-------------------------------
    Priority: Critical  (was: Major)

> ConcurrentModificationException in KafkaProducer event loop
> -----------------------------------------------------------
>
>                 Key: KAFKA-4557
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4557
>             Project: Kafka
>          Issue Type: Bug
>          Components: clients
>    Affects Versions: 0.10.1.0
>            Reporter: Sergey Alaev
>            Priority: Critical
>              Labels: reliability
>             Fix For: 0.10.2.0
>
>
> Under heavy load, Kafka producer can stop publishing events. Logs below.
> [2016-12-19T15:01:28.779Z] [sgs] [kafka-producer-network-thread | producer-3] [NetworkClient] [] [<none>] [] [DEBUG]: Disconnecting from node 2 due to request timeout.
> [2016-12-19T15:01:28.793Z] [sgs] [kafka-producer-network-thread | producer-3] [KafkaProducerClient] [] [<none>] [1B2M2Y8Asg] [WARN]: Error sending message to Kafka
> org.apache.kafka.common.errors.NetworkException: The server disconnected before a response was received.
> [2016-12-19T15:01:28.838Z] [sgs] [kafka-producer-network-thread | producer-3] [KafkaProducerClient] [] [<none>] [1B2M2Y8Asg] [WARN]: Error sending message to Kafka
>   org.apache.kafka.common.errors.NetworkException: The server disconnected before a response was received. (#2 from 2016-12-19T15:01:28.793Z)
> --------------------------------
> [2016-12-19T15:01:28.956Z] [sgs] [kafka-producer-network-thread | producer-3] [KafkaProducerClient] [] [<none>] [1B2M2Y8Asg] [WARN]: Error sending message to Kafka
>   org.apache.kafka.common.errors.TimeoutException: Expiring 46 record(s) for events-deadletter-0 due to 30032 ms has passed since batch creation plus linger time (#285 from 2016-12-19
> T15:01:28.793Z)
> [2016-12-19T15:01:28.956Z] [sgs] [kafka-producer-network-thread | producer-3] [SgsService] [] [<none>] [1B2M2Y8Asg] [WARN]: Error writing signal to Kafka deadletter queue
>   org.apache.kafka.common.errors.TimeoutException: Expiring 46 record(s) for events-deadletter-0 due to 30032 ms has passed since batch creation plus linger time (#286 from 2016-12-19
> T15:01:28.793Z)
> [2016-12-19T15:01:28.960Z] [sgs] [kafka-producer-network-thread | producer-3] [Sender] [] [<none>] [1B2M2Y8Asg] [ERROR]: Uncaught error in kafka producer I/O thread:
> java.util.ConcurrentModificationException: null
>         at java.util.ArrayDeque$DeqIterator.next(ArrayDeque.java:643) ~[na:1.8.0_45]
>         at org.apache.kafka.clients.producer.internals.RecordAccumulator.abortExpiredBatches(RecordAccumulator.java:242) ~[kafka-clients-0.10.1.0.jar:na]
>         at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:212) ~[kafka-clients-0.10.1.0.jar:na]
>         at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:135) ~[kafka-clients-0.10.1.0.jar:na]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
> [2016-12-19T15:01:28.981Z] [sgs] [kafka-producer-network-thread | producer-3] [NetworkClient] [] [<none>] [1B2M2Y8Asg] [WARN]: Error while fetching metadata with correlation id 28711 : {events-deadletter=LEADER_NOT_AVAILABLE}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)