Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9D9C4200CE0 for ; Fri, 11 Aug 2017 02:01:20 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 9C35616C71A; Fri, 11 Aug 2017 00:01:20 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E18B216C719 for ; Fri, 11 Aug 2017 02:01:19 +0200 (CEST) Received: (qmail 68475 invoked by uid 500); 11 Aug 2017 00:01:18 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 68463 invoked by uid 99); 11 Aug 2017 00:01:18 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Aug 2017 00:01:18 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id DC49E1807E0 for ; Fri, 11 Aug 2017 00:01:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 5kZ9huLXW-DB for ; Fri, 11 Aug 2017 00:01:13 +0000 (UTC) Received: from mail-oi0-f53.google.com (mail-oi0-f53.google.com [209.85.218.53]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id AA2DC5F1BA for ; Fri, 11 Aug 2017 00:01:12 +0000 (UTC) Received: by mail-oi0-f53.google.com with SMTP id g131so21015337oic.3 for ; Thu, 10 Aug 2017 17:01:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=j3G8EuuUovUCu1gJijtFX8q0vepW4GV0SfIVQF8FUBs=; b=dwcy4n/H852e3vYkFukHMxiv53ICeYm2N/HNN/QEvSTPGk+9vGY5XGkRk3wiY+Jfwm uDC6Utd2lcofnxj5cq0S6l+5yHMv6OXO5HP0infDocMp/Kz38+66Uoai8bQEKCtHm3Os 3nYeL8QwjVrNV1v5ICSZ+0TQx00of5xvQANe7EWlvi5n4fnY0eweWFNRQ7iNbdqv6CqN Cos9jgJN3kVpEg784jjeE+2VDR8sfaLQRw5PMKnn+LAzBisupqg2Mr4VRH0uGwmnPbQg M5A4bDOsnI6v3wKXcVEwESZ72AjWIOnM++2VVxPOSD8c/VVRSSTq7aEJf5LeRSAIoqXZ mzMQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=j3G8EuuUovUCu1gJijtFX8q0vepW4GV0SfIVQF8FUBs=; b=MGXOBpjQ4JMX6Ibnc3aGVrgk1RSv1VntRwkR+Qn1BIV2p24goLP2k9fZA+35UDTv9z jAJ/xRZGajxh9HwG9ufNPSku6504WVhi7wEmm7mAJJI9Lr1NlHbjyXfQA1gab1GwcTpd ka7QTY+LmCa5984Qm/wDzj9gAxFA9PpevUeazGhVzqBC5ry7vFP9pHhpxVulj9I9jbLJ V98Nl5MA77k83AyuVgduU+TH3/uoEmqAeCuJ7b4UzqsM2reTtJwZigTK0Qgrvbo4TV0D ofO1xUUVaCVMpuaT21BGl3onRbZXiaHfC0iNH3oQdF5aWIazb2anxWiI88L5F3W2GYsa f63g== X-Gm-Message-State: AHYfb5j2RwL46rjb2FvVucdefAzUU5GHWJtRedAdLimhktkCEZSTSkra 8k7Lm6g7BXB+1HB1SMq5asVr6/ZKiQ== X-Received: by 10.202.205.143 with SMTP id d137mr16713699oig.126.1502409670666; Thu, 10 Aug 2017 17:01:10 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.235.116 with HTTP; Thu, 10 Aug 2017 17:01:10 -0700 (PDT) In-Reply-To: References: From: Guozhang Wang Date: Thu, 10 Aug 2017 17:01:10 -0700 Message-ID: Subject: Re: [DISCUSS] KIP-186: Increase offsets retention default to 7 days To: "dev@kafka.apache.org" Content-Type: multipart/alternative; boundary="001a1134e13eba36e205566f02ed" archived-at: Fri, 11 Aug 2017 00:01:20 -0000 --001a1134e13eba36e205566f02ed Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable +1 from me On Wed, Aug 9, 2017 at 9:40 AM, Jason Gustafson wrote: > +1 on the bump to 7 days. Wanted to mention one minor point. The > OffsetCommit RPC still provides the ability to set the retention time fro= m > the client, but we do not use it in the consumer. Should we consider addi= ng > a consumer config to set this? Given the problems people had with the old > default, such a config would probably have gotten a fair bit of use. Mayb= e > it's less necessary with the new default, but there may be situations whe= re > you don't want to keep the offsets for too long. For example, the console > consumer commits offsets with a generated group id. We might want to set = a > low retention time to keep it from filling the offset cache with garbage > from such groups. > I agree with Jason here, but maybe itself deserves a separate KIP discussion. > > -Jason > > On Wed, Aug 9, 2017 at 5:24 AM, S=C3=B6nke Liebau < > soenke.liebau@opencore.com.invalid> wrote: > > > Just had this create issues at a customer as well, +1 > > > > On Wed, Aug 9, 2017 at 11:46 AM, Mickael Maison < > mickael.maison@gmail.com> > > wrote: > > > > > Yes the current default is too short, +1 > > > > > > On Wed, Aug 9, 2017 at 8:56 AM, Ismael Juma wrote= : > > > > Thanks for the KIP, +1 from me. > > > > > > > > Ismael > > > > > > > > On Wed, Aug 9, 2017 at 1:24 AM, Ewen Cheslack-Postava < > > ewen@confluent.io > > > > > > > > wrote: > > > > > > > >> Hi all, > > > >> > > > >> I posted a simple new KIP for a problem we see with a lot of users= : > > > >> KIP-186: Increase offsets retention default to 7 days > > > >> > > > >> https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > > >> 186%3A+Increase+offsets+retention+default+to+7+days > > > >> > > > >> Note that in addition to the KIP text itself, the linked JIRA > already > > > >> existed and has a bunch of discussion on the subject. > > > >> > > > >> -Ewen > > > >> > > > > > > > > > > > -- > > S=C3=B6nke Liebau > > Partner > > Tel. +49 179 7940878 > > OpenCore GmbH & Co. KG - Thomas-Mann-Stra=C3=9Fe 8 - 22880 Wedel - Germ= any > > > --=20 -- Guozhang --001a1134e13eba36e205566f02ed--