Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D5883200D5D for ; Wed, 20 Dec 2017 16:40:12 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id D3B82160C12; Wed, 20 Dec 2017 15:40:12 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2517C160C0A for ; Wed, 20 Dec 2017 16:40:11 +0100 (CET) Received: (qmail 7189 invoked by uid 500); 20 Dec 2017 15:40:06 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 7177 invoked by uid 99); 20 Dec 2017 15:40:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Dec 2017 15:40:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 86A471A0B96 for ; Wed, 20 Dec 2017 15:40:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.001 X-Spam-Level: X-Spam-Status: No, score=-100.001 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_NONE=-0.0001, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id A47Zo1xBP1pr for ; Wed, 20 Dec 2017 15:40:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 9DB615FB2A for ; Wed, 20 Dec 2017 15:40:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 3BCC3E0C25 for ; Wed, 20 Dec 2017 15:40:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 6795F240EA for ; Wed, 20 Dec 2017 15:40:00 +0000 (UTC) Date: Wed, 20 Dec 2017 15:40:00 +0000 (UTC) From: "Clemens Valiente (JIRA)" To: dev@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (KAFKA-6391) output from ensure copartitioning is not used for Cluster metadata MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 20 Dec 2017 15:40:13 -0000 Clemens Valiente created KAFKA-6391: --------------------------------------- Summary: output from ensure copartitioning is not used for Cluster metadata Key: KAFKA-6391 URL: https://issues.apache.org/jira/browse/KAFKA-6391 Project: Kafka Issue Type: Bug Components: streams Affects Versions: 1.0.0 Reporter: Clemens Valiente Assignee: Clemens Valiente https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamPartitionAssignor.java#L366 Map allRepartitionTopicPartitions is created from repartitionTopicMetadata THEN we do ensureCoPartitioning on repartitionTopicMetadata THEN we create topics and partitions according to repartitionTopicMetadata THEN we use allRepartitionTopicPartitions to create our Cluster fullMetadata THEN we use fullMetadata to assign the tasks and no longer use repartitionTopicMetadata This results in any change to repartitionTopicMetadata in ensureCoPartitioning to be used for creating partitions but no tasks are ever created for any partition added by ensureCoPartitioning() the fix is easy: First ensureCoPartitioning() on repartitionTopicMetadata before creating allRepartitionTopicPartitions -- This message was sent by Atlassian JIRA (v6.4.14#64029)