Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 68B4F2009A8 for ; Tue, 17 May 2016 16:13:16 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 674CC1609F5; Tue, 17 May 2016 14:13:16 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D762D1607A8 for ; Tue, 17 May 2016 16:13:15 +0200 (CEST) Received: (qmail 66847 invoked by uid 500); 17 May 2016 14:13:13 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 66442 invoked by uid 99); 17 May 2016 14:13:13 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 May 2016 14:13:13 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 3CD5F2C1F80 for ; Tue, 17 May 2016 14:13:13 +0000 (UTC) Date: Tue, 17 May 2016 14:13:13 +0000 (UTC) From: "Ismael Juma (JIRA)" To: dev@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (KAFKA-1072) Allow mulitple topics selected with a TopicFilter to be balanced among consumers MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 17 May 2016 14:13:16 -0000 [ https://issues.apache.org/jira/browse/KAFKA-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-1072: ------------------------------- Fix Version/s: (was: 0.10.1.0) 0.8.2.0 > Allow mulitple topics selected with a TopicFilter to be balanced among consumers > -------------------------------------------------------------------------------- > > Key: KAFKA-1072 > URL: https://issues.apache.org/jira/browse/KAFKA-1072 > Project: Kafka > Issue Type: Bug > Affects Versions: 0.8.0 > Reporter: Jason Rosenberg > Fix For: 0.8.2.0 > > > Currently, there is no parallelism used when consuming a set of topics selected by a white list topic filter, if those topics all have a partition count of 1. Currently, all topics that match the filter get assigned to the same thread on the same consumer, even though there may be plenty of different topics (and therefore many partitions to be consumed from). > There are often good reasons to use a partition count of only 1 (e.g. to preserve message ordering). For arbitrary scalability, over a large number of topics, this would be a great benefit to be able to consume topics balanced over a set of available consumers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)