Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 55C86200C7B for ; Sat, 6 May 2017 03:03:00 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 54295160BBE; Sat, 6 May 2017 01:03:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 9B254160BAF for ; Sat, 6 May 2017 03:02:59 +0200 (CEST) Received: (qmail 31726 invoked by uid 500); 6 May 2017 01:02:58 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 31714 invoked by uid 99); 6 May 2017 01:02:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 06 May 2017 01:02:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id BD843C002B for ; Sat, 6 May 2017 01:02:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.479 X-Spam-Level: ** X-Spam-Status: No, score=2.479 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=confluent-io.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id dcdpBF3KW2a3 for ; Sat, 6 May 2017 01:02:55 +0000 (UTC) Received: from mail-yw0-f181.google.com (mail-yw0-f181.google.com [209.85.161.181]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id A2F515F569 for ; Sat, 6 May 2017 01:02:55 +0000 (UTC) Received: by mail-yw0-f181.google.com with SMTP id 203so10203872ywe.0 for ; Fri, 05 May 2017 18:02:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=confluent-io.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=zTAx4JXsdZg4GmnZdVgH2tlrlcEQKHaAwhohVnIDtgc=; b=hh+mvLChuuTKWxaDp4Jyjqh8MU0U9FeXGMYM/c4ciUaLoBEg91f6wTBa7IfrkD67RY VKOmxn3jPUiNTokKbuqpu0zFnsO0WdElPfNDaFHLbCEZbnmRxumGpvsmajeyA8UanbJa lcKDNLkgEKafLgbXmtfOB4wIVCiBD4J2De7R9x/pnG6fJCOTomCcYTwqfRuFg3WoLedO X7jOQCpXjj7q0VWeH/KpcYRaY1tUep2yFd+2AJhpaB7w1/VwAZ7wKYseEB6fHmYwN1ls jyFJLZzdeP4CtDL84XlGsqOgNYq7zbdWgwJ2xqokXVPqpv7Z4v62T9WmZ5rQNIW1TJol JdXA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=zTAx4JXsdZg4GmnZdVgH2tlrlcEQKHaAwhohVnIDtgc=; b=kJzl0M3ZC5JP5xYsYqA14NqqWT17hvbD+zdXhFC5cc2PQ+iTte3Q2q5g2ZprOEbxv5 kl9mrndw3ibY3Lc/X6+kDqB4kbEj7jLmH7J6SirMKQOQoxSUlD08P9vC6Tzj5LsVifWU wOsU2MSvS3SfJSF0C4x/utTnv34oMpag14IAgyEhjqdAaMwM/sdfzqNxIp3eu06wIDOu /rDNtTkGG3kaLJie7MD593KJmhID2zNnDqxdXK2vYCiUBswvax7oFhyEemb/jf3zvJYr 3Wg5nBdxQhiQWPL4v1Gr0jRSeHinSeMI85BL9pWJKKqEVLDCAYlPpRTfYQ+DhsEiu8DI wCMQ== X-Gm-Message-State: AN3rC/7Vyjr451Dq/V+6R6npd9H+IcRacH7IiD5p5ngGk2S7Vrku/ZPB 3DlGTBQ38pRom/K1BC3zBz8LZbBW72iV X-Received: by 10.13.235.9 with SMTP id u9mr8987356ywe.96.1494032569422; Fri, 05 May 2017 18:02:49 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.231.9 with HTTP; Fri, 5 May 2017 18:02:48 -0700 (PDT) In-Reply-To: References: From: Gwen Shapira Date: Fri, 5 May 2017 18:02:48 -0700 Message-ID: Subject: Re: [DISCUSS] KIP-154 Add Kafka Connect configuration properties for creating internal topics To: dev@kafka.apache.org Content-Type: multipart/alternative; boundary=94eb2c0876789570d9054ed09022 archived-at: Sat, 06 May 2017 01:03:00 -0000 --94eb2c0876789570d9054ed09022 Content-Type: text/plain; charset=UTF-8 Looks great to me :) Just one note - configurations have levels (which reflect in the docs) - I suggest putting the whole thing as LOW. Most users will never need to worry about these. For same reason I recommend leaving them out of the example config files - we already have issues with users playing with configs without understanding what they are doing and not liking the results. On Fri, May 5, 2017 at 3:42 PM, Randall Hauch wrote: > Hi, all. > > I've been working on KAFKA-4667 to change the distributed worker of Kafka > Connect to look for the topics used to store connector and task > configurations, offsets, and status, and if those tasks do not exist to > create them using the new AdminClient. To make this as useful as possible > and to minimize the need to still manually create the topics, I propose > adding several new distributed worker configurations to specify the > partitions and replication factor for these topics, and have outlined them > in "KIP-154 Add Kafka Connect configuration properties for creating > internal topics". > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 154+Add+Kafka+Connect+configuration+properties+for+ > creating+internal+topics > > Please take a look and provide feedback. Thanks! > > Best regards, > > Randall > -- *Gwen Shapira* Product Manager | Confluent 650.450.2760 | @gwenshap Follow us: Twitter | blog --94eb2c0876789570d9054ed09022--