Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id AB737200D42 for ; Fri, 17 Nov 2017 09:08:07 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id A9BA6160BFB; Fri, 17 Nov 2017 08:08:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C8D6E160BF8 for ; Fri, 17 Nov 2017 09:08:06 +0100 (CET) Received: (qmail 27727 invoked by uid 500); 17 Nov 2017 08:08:06 -0000 Mailing-List: contact jira-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@kafka.apache.org Delivered-To: mailing list jira@kafka.apache.org Received: (qmail 27716 invoked by uid 99); 17 Nov 2017 08:08:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Nov 2017 08:08:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 371971A12B5 for ; Fri, 17 Nov 2017 08:08:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id mcz08n2OcYHF for ; Fri, 17 Nov 2017 08:08:03 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 28DBC60D11 for ; Fri, 17 Nov 2017 08:08:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 53EC3E0AA3 for ; Fri, 17 Nov 2017 08:08:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 61461240E2 for ; Fri, 17 Nov 2017 08:08:00 +0000 (UTC) Date: Fri, 17 Nov 2017 08:08:00 +0000 (UTC) From: "Alex Dunayevsky (JIRA)" To: jira@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (KAFKA-6221) ReplicaFetcherThread throws UnknownTopicOrPartitionException on topic creation MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 17 Nov 2017 08:08:07 -0000 [ https://issues.apache.org/jira/browse/KAFKA-6221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Dunayevsky updated KAFKA-6221: ----------------------------------- Summary: ReplicaFetcherThread throws UnknownTopicOrPartitionException on topic creation (was: ReplicaFetcherThread throws UnknownTopicOrPartitionExeption on topic creation ) > ReplicaFetcherThread throws UnknownTopicOrPartitionException on topic creation > ------------------------------------------------------------------------------- > > Key: KAFKA-6221 > URL: https://issues.apache.org/jira/browse/KAFKA-6221 > Project: Kafka > Issue Type: Bug > Components: core > Affects Versions: 0.10.2.0, 0.10.2.1 > Environment: RHEL 7 > Reporter: Alex Dunayevsky > Original Estimate: 336h > Remaining Estimate: 336h > > This issue appeared to happen frequently on 0.10.2.0. > On 0.10.2.1 it's a way harder to reproduce. > We'll focus on reproducing it on 0.10.2.1. > *TOPOLOGY:* > 3 brokers, 1 zk. > *REPRODUCING STRATEGY:* > Create a few dozens topics (say, 40) one by one, each with replication factor 2. Number of partitions, generally, does not matter but, for easier reproduction, should not be too small (around 30 or so). > *CREATE 40 TOPICS:* > {code:java} for i in {1..40}; do bin/kafka-topics.sh --create --topic "topic${i}_p28_r2" --partitions 28 --replication-factor 2 --zookeeper :2165; done {code} > *ERRORS* > {code:java} > *BROKER 1* > [2017-11-15 16:46:00,853] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,27] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,853] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,27] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,9] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,9] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,3] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,3] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,15] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,15] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,21] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,21] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > *BROKER 2* > [2017-11-15 16:46:36,408] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,12] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,408] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,12] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,0] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,0] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,6] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,6] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,24] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,24] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,18] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,18] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > *BROKER 3* > [2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,16] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,16] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,10] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,10] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,4] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,4] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,22] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > [2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,22] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread) > {code} > *RESULTS:* > As you can see, the problem occurs on > * partitions [3,9,15,21,27] of topic `{{topic1_p28_r2}}` > * partitions [0,6,12,18,14] of topic `{{topic20_p28_r2}}` > * partitions [4,10,16,22] of topic `{{topic30_p28_r2}}` > Partitions are either odd or even. > Every "unlucky" partition, except the starting one, for each topic, appears to be the 6th in the row. For instance: > * 3, 9(3+6), 15(3+6+6), ... > * 0, 6(0+6), 12(0+6+6), ... > * 4, ... -- This message was sent by Atlassian JIRA (v6.4.14#64029)