Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 38680200B5B for ; Fri, 5 Aug 2016 16:34:38 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 35A7C160A64; Fri, 5 Aug 2016 14:34:38 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7FFE6160A8E for ; Fri, 5 Aug 2016 16:34:37 +0200 (CEST) Received: (qmail 38263 invoked by uid 500); 5 Aug 2016 14:34:36 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 37823 invoked by uid 99); 5 Aug 2016 14:34:36 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Aug 2016 14:34:36 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id CB44BC7593 for ; Fri, 5 Aug 2016 14:34:35 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=heroku.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id CPi3ROA2xnos for ; Fri, 5 Aug 2016 14:34:33 +0000 (UTC) Received: from mail-yw0-f181.google.com (mail-yw0-f181.google.com [209.85.161.181]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id BC0405F20C for ; Fri, 5 Aug 2016 14:34:32 +0000 (UTC) Received: by mail-yw0-f181.google.com with SMTP id u134so268431688ywg.3 for ; Fri, 05 Aug 2016 07:34:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heroku.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=aQKdW4ySPXZCO1NZ/k09i2b6Y6f4ZK3ROytfjHxP/OU=; b=w/VhNf1rcbA4bfI2ukrgMbY3qplkhcLqCoMEA9usmCBkbKawmyk9tXMohW+SueLFis yN9opSRpZz7FgFTaI6+fm25lU7DnVr+y7YK+GRIrZ6AAG0nwZUI/rlLCOOamb7ydkmG2 l+kAbDA1J8BPF5D5BR3QtHN+MmN7cgSmz++PxeIrfx4i84Fs/Qr1N75u9Tkde5zkBW/t g+0mz4saHQlNRN5t0uUUWRAyXm4/NlgJPHwAjK6h4vuu+L4ZvJigiAlMLqnnVgBGIiVc uLIS6OrR1XJlSmvpAzPsKmTCw72e8Wp3ae6xRMqgI+vxreD5HFNh3jdhEukTIU3DzyZy R4fQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=aQKdW4ySPXZCO1NZ/k09i2b6Y6f4ZK3ROytfjHxP/OU=; b=atOVjop4Ju2g5COZlH3UK2EpVnv/s0YN9mqt0y0i1xguy9chpeUfXwjU80UHRTfwm1 YlUDqGXN3Q5rYsI3HOjRUEwWFlfe+uJRZlL7n5QJguXneR4rdXZgS79q0+rq8sVdMKE7 /u9RujzFBBIURbQZUDNJVgJia/6q3peUf3zXk4WxFCrtq9jPhAhD53ex/W+tjM7xVnKE AmrM5Z7jbsHy3e9UrfuufWbwyj1r27bRDaHFivGcLzuXgWoRXbA4Mj5kUgGuGpxco28p WmCQGUToSBEv1JOZP7Tn9BVgvyZg0pB7Y60Zdahyl0sef6JCJJS7uzrE99wLi3mDU3/S jMtA== X-Gm-Message-State: AEkoouungpMaFF9LndJ3y0h0hWRI5s3o2BG/1Mhs5m0SPCJ/mn6MUeJzLD+Fe+MwKBaMJ/Pv3CDMjFlmLlAXuUpt X-Received: by 10.13.203.18 with SMTP id n18mr58722525ywd.122.1470407671633; Fri, 05 Aug 2016 07:34:31 -0700 (PDT) MIME-Version: 1.0 Received: by 10.129.19.212 with HTTP; Fri, 5 Aug 2016 07:34:30 -0700 (PDT) In-Reply-To: References: From: Tom Crayford Date: Fri, 5 Aug 2016 15:34:30 +0100 Message-ID: Subject: Re: [DISCUSS] KIP-72 Allow Sizing Incoming Request Queue in Bytes To: "dev@kafka.apache.org" Content-Type: multipart/alternative; boundary=001a114e6b3af1b8b9053953f667 archived-at: Fri, 05 Aug 2016 14:34:38 -0000 --001a114e6b3af1b8b9053953f667 Content-Type: text/plain; charset=UTF-8 This makes good sense to me, and seems to have very low amounts of downside with large amounts of upside. +1 On Thursday, 4 August 2016, radai wrote: > Hello, > > I'd like to initiate a discussion about > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 72%3A+Allow+Sizing+Incoming+Request+Queue+in+Bytes > > The goal of the KIP is to allow configuring a bound on the capacity (as in > bytes of memory used) of the incoming request queue, in addition to the > current bound on the number of messages. > > This comes after several incidents at Linkedin where a sudden "spike" of > large message batches caused an out of memory exception. > > Thank you, > > Radai > --001a114e6b3af1b8b9053953f667--