From dev-return-67970-archive-asf-public=cust-asf.ponee.io@zookeeper.apache.org Sun Mar 4 12:40:23 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id F0711180649 for ; Sun, 4 Mar 2018 12:40:22 +0100 (CET) Received: (qmail 59676 invoked by uid 500); 4 Mar 2018 11:40:21 -0000 Mailing-List: contact dev-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@zookeeper.apache.org Delivered-To: mailing list dev@zookeeper.apache.org Received: (qmail 59660 invoked by uid 99); 4 Mar 2018 11:40:20 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 04 Mar 2018 11:40:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 8D4A7C1452 for ; Sun, 4 Mar 2018 11:40:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id tvEZ-eqf8rop for ; Sun, 4 Mar 2018 11:40:19 +0000 (UTC) Received: from mail-lf0-f49.google.com (mail-lf0-f49.google.com [209.85.215.49]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E1C8F5F125 for ; Sun, 4 Mar 2018 11:40:18 +0000 (UTC) Received: by mail-lf0-f49.google.com with SMTP id h127so18164035lfg.12 for ; Sun, 04 Mar 2018 03:40:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=pYQP70oLuKbaEN6ibzpJL+Uqy+fkQS4cOog6BGcqjNw=; b=nUdYDOupPDXIyojGfYd6dVzWfUOdxhxrCTQj13E0x6G16Hhfq6ywNTOH/CosL+rR1c /jwccpTwFnzfFHSUixu+GYWV2JPdq9XY7EFH/En1jc4cX2A6J20BX3kibqKX/jWfAi7O THLgrBZ21KJc1M4uK4rzrJ0P6aTH1avaeaUu3QbVGkb6jxaIx0icI4cXuRYTm1HIJDFy VGwffhBl3e4feXkspelojEhqQ+Ypn2SI73O4YxGh4rUhft2q6X2xnBtT6Fl3v0QueJlO B+SkQoT77J8IdqcdRemF8apSc+T+3oRldqYmMjyAhdOH4E2qZoZiLgqrqEx2/Ln876B3 8pGw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=pYQP70oLuKbaEN6ibzpJL+Uqy+fkQS4cOog6BGcqjNw=; b=TtGNMzQu6sEGI2ugpja/dWOReoPcrh8Z8Itq1G+2uX/sld/SNPq69Wo0j0J0AJHoam XWYxGZ8dCiLUCwbcRT5Jno0BOK6H5ycpgsd6UEDcmj7LXjnB10M8rznk6Qy+80UDJxzS l/ugLHIQ9ifPSXogNuPVOIQXp2O+YWdgsMnWKE0w1p6I4X8c2KrZBIKD/ND84yLefNnE CFsImpOBapgSdDe3qm2fyQx4bFnpGFvMpenzxn/y9nWz0lc/LCNAt4RLXbkZx5TXXteJ lMj1EsZy1/S0Eghd3Mw/o8HtNSyC7+rNSGS7s/1/zviKiN0xX5RPaDhAqUwXuSAudhrp x50Q== X-Gm-Message-State: AElRT7HDpwvslnHTC54xeqDBU++PnDE6rOSOecCWGb+CguhzbKGFGuoo AsgnUEV4pPFAUK7gAmtgiaErxbxLG9eow6d/PHXKj9/f X-Google-Smtp-Source: AG47ELsoh98LJTPKApNPDwKfHHb1BD6smKPlubwUaqm18nx/W6toCnSZ+DZbtND1H6iC4MtQZScUQilPgd2E20wHdj4= X-Received: by 10.46.25.209 with SMTP id 78mr7593231ljz.29.1520163611196; Sun, 04 Mar 2018 03:40:11 -0800 (PST) MIME-Version: 1.0 Received: by 10.46.48.26 with HTTP; Sun, 4 Mar 2018 03:40:10 -0800 (PST) In-Reply-To: <5A9AB270.2080306@chrismiles.org> References: <5A9AB04D.5090806@chrismiles.org> <5A9AB270.2080306@chrismiles.org> From: Mark Fenes Date: Sun, 4 Mar 2018 12:40:10 +0100 Message-ID: Subject: Re: Connection Factories for Curator / Zookeeper / HTTP Tunneling To: dev@zookeeper.apache.org Cc: chris@chrismiles.org Content-Type: multipart/alternative; boundary="94eb2c1a63e40bf130056694ace2" --94eb2c1a63e40bf130056694ace2 Content-Type: text/plain; charset="UTF-8" Hi Chris, yes, ports 2888 and 3888 are the default ports for quorum communication and leader election. By default, ZK uses NIOServerCnxnFactory, unless the zookeeper.serverCnxnFactory system property is set to a different connection factory (e.g. Netty). So, you would like to configure and run the ZooKeeper server instances so that the quorum communication and leader election would also take place on the HTTP port via tunnelling? Let me check this as I need to do further research to answer this question. And yes, should ZK not have this functionality, we would be very thankful for your willingness to contribute to the source code. Regards, Mark On Sat, Mar 3, 2018 at 3:34 PM, Chris Miles wrote: > > Firstly, I apologise for the cross post, but I think this is a question > which may need to be seen by both users, and devs who understand the > underlying code. > > I need to deploy Zookeeper to a firewall restricted cloud-foundry cloud, > where the only communication can happen between nodes is through HTTP, > so I am looking at ways of getting ZooKeeper communicating through HTTP > tunnelling. > > As far as I can determine, ZooKeeper only allows the configuring of the > main client connection via server and client connection factories, but > not for the 2888 and 3888 connectivity, which is I think ((correct me if > wrong)) node to node communication on the first one, and leader election > on the second? > > Does Zookeeper's connection handling give me any ability to intercept and > wrap the connections used for the rest of these ports? (Netty Http Tunnel). > > I am willing to contribute to the source to get this functionality if > required > as this is currently our only way of getting Zookeeper on our cloud. > > thanks > > Chris > > > > --94eb2c1a63e40bf130056694ace2--