From user-return-12175-archive-asf-public=cust-asf.ponee.io@zookeeper.apache.org Fri Sep 27 17:01:40 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id D68FA180638 for ; Fri, 27 Sep 2019 19:01:39 +0200 (CEST) Received: (qmail 29892 invoked by uid 500); 27 Sep 2019 17:01:38 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 29879 invoked by uid 99); 27 Sep 2019 17:01:38 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Sep 2019 17:01:38 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id C8372C0DB8 for ; Fri, 27 Sep 2019 17:01:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.05 X-Spam-Level: ** X-Spam-Status: No, score=2.05 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id tGNOQE1oG_gZ for ; Fri, 27 Sep 2019 17:01:35 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::433; helo=mail-wr1-x433.google.com; envelope-from=shyue2010@gmail.com; receiver= Received: from mail-wr1-x433.google.com (mail-wr1-x433.google.com [IPv6:2a00:1450:4864:20::433]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id F35057DD96 for ; Fri, 27 Sep 2019 17:01:34 +0000 (UTC) Received: by mail-wr1-x433.google.com with SMTP id q17so4007121wrx.10 for ; Fri, 27 Sep 2019 10:01:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=zVqum4gcxXKaC/yuoYRc2XdZCyB5mZMIZMI2PCc1U58=; b=XW5BWHComfRBaNg/S39kIP3JLr15K+0hW6qZPKhdkEQnb8/P+M6VhuBAqnRg4ESh6S x/LzVTbPX+weqM/0ePbXCzflLbwCVN5iObOecajGDNE2/V/wdBjPUJg8vhfa8dMRQyU2 bn5bhP0BOFLRper0E+rWdtdTrvFWxOXIPl7jtpqKr3DwY+wcB4Gz6IMavrYpSQwATYFD f7RmDlblA5ZZx1j86NCeZvnNzVnhGy8kVxlEP0eQAcrPcp+lj/9+FCVIXHzgkMch8uty y12vpuRN/bJfO6wYf9yalQeVWgQPv9zUgzTr4dogD6HVhGo/yuz1xbrvuOc6GF7l7lKn YiqA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=zVqum4gcxXKaC/yuoYRc2XdZCyB5mZMIZMI2PCc1U58=; b=dxGElL4SgmbnogLtbWvffhDZVVUT0KlDK6aNNEfHMk9vmX0ngI/YHT7X1GS1v+1XVm AO1GZ3vFOVI9S0WZh9m832tW/22S1zKMtaP+1u09xS9pK+VLJOgjWL8OBVMAr7eHaTYE JZN7jtDRqi5k0KrelRqUF4koJ9vGiwtUW12Hbb+NrQa5eQsbLM6QOrQrFDwvmj0tMN2K 2t6UWldZpfIya3UvIdYUstoBUjzuYjlbBiTDFCEJIxsWeVmrDdBwEV8eaqs6I02acSpm KnQfCZUN9ntog33jYp+OngCNfx/kUclp714bTolFKNqfmCwnvtZ/Lyz7/Nf3WDl5gfdL i4pg== X-Gm-Message-State: APjAAAUyi6ErSV9pGE8AVJG2f9gCC+YzY3oK1RRLMR/buswTqebj9IdC +6DCKDSMhp8sG+vTimv9xNxBhyEfUhLkqse3PUYOeYZv X-Google-Smtp-Source: APXvYqzjGBj5lpa3OpfDnKxRWFYAtpp6ZNZzsY32Yt83gm7r0IsDC7p5DD6L+dASwBoDAXxy2R2NZew5wCoLwL51TbI= X-Received: by 2002:a7b:cbc5:: with SMTP id n5mr8528185wmi.31.1569603694027; Fri, 27 Sep 2019 10:01:34 -0700 (PDT) MIME-Version: 1.0 From: Yue Shen Date: Fri, 27 Sep 2019 10:01:23 -0700 Message-ID: Subject: How to scale ZooKeeper to support 10K concurrent connections? To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary="0000000000009ee8d305938bd6e5" --0000000000009ee8d305938bd6e5 Content-Type: text/plain; charset="UTF-8" Dear ZooKeeper users, I have a special use case, in which I use AWS lambda service. Inside the lambda service logic, it goes to ZooKeeper to check the worker for the data, if exists, connect to the worker endpoint and send the data. If the worker isn't assigned, the logic will post a new assignment, and wait for it to be assigned to a worker. There is a coordinator to watch the new assignment and assign tasks. My problem comes with AWS Lambda service, which can launch tens of thousands of calls. When this happens, I found many calls get timeout. The active connections to ZooKeeper plateau around 6500. BTW, I run ZooKeeper as 3 node ensemble, run on Quorum. How can I scale ZooKeeper to support more concurrent connections? Thank you, Yue --0000000000009ee8d305938bd6e5--