From user-return-14379-archive-asf-public=cust-asf.ponee.io@storm.apache.org Mon Apr 15 09:31:20 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 7D26A18064C for ; Mon, 15 Apr 2019 11:31:20 +0200 (CEST) Received: (qmail 75782 invoked by uid 500); 15 Apr 2019 09:31:17 -0000 Mailing-List: contact user-help@storm.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.apache.org Delivered-To: mailing list user@storm.apache.org Received: (qmail 75771 invoked by uid 99); 15 Apr 2019 09:31:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Apr 2019 09:31:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 14BC71805E7 for ; Mon, 15 Apr 2019 09:31:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.8 X-Spam-Level: ** X-Spam-Status: No, score=2.8 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id EuSHW_waxT_b for ; Mon, 15 Apr 2019 09:31:15 +0000 (UTC) Received: from mail-oi1-f179.google.com (mail-oi1-f179.google.com [209.85.167.179]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 30CBC5FCDC for ; Mon, 15 Apr 2019 09:31:15 +0000 (UTC) Received: by mail-oi1-f179.google.com with SMTP id v7so13153739oie.8 for ; Mon, 15 Apr 2019 02:31:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=M2+eJpdX0b1FdJ4keFe8jAc0aXlLRnXQuDMwyNLvpuw=; b=FqN3FPYTrYVY8TuJIhrm69l91XumPIGlD38a0+pD9xSOcRidxHoarTebjNB2sJ1mi3 2ySZ2ww7T2iPAL+SAV1k/jTVbz1ING5aKsxDsQy/Ok49r33R43sBjVlKKi4GUoSKhogX Xtzo9QIKsRIX9DBa03WgfVlx+gHYsIp9vdkOhvH0O+Hy37se4BLV/1YkEcBySeXBzk2O q8kb1abb9Rob0Ak9sGPKlIHcadjyaqEXBI8dXIcG7+TiBlc+ZQw0yV2E7mCKWtzkG50x aXDIM2ZjKaoRyWO1WMl9Iqc2K7BxATUK9yRn88E9qcV+hVAVMuC3nvUP8KyVdxR3iSHG 2RFQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=M2+eJpdX0b1FdJ4keFe8jAc0aXlLRnXQuDMwyNLvpuw=; b=Kovp/LenXzNVbWs4XQ9ZgyS7V/J+veEGn0FoYCUuIVvrchCDRcahzO4rqevQmwxrzl V3YNi5xWqeCyplj/cvHZsu5YX0Jbdj1KQ7W023EYOrY1phpBH3BtoIAw/2iDMHy7HzzK Xdy/0e9XjLfemsXtuYHf9JJNDadqXTJAbCDMfiL6C8yMEmbV/h5EtKw2p9EA7jyubsJn 3xEUTRYqVXUp9Sch8rjuiHaXp4W4XOGqyRbCCfmrpi0ZV5mRqt/Gp0MSBPFSeHDj0tsR cxNits9pyA6bb0eg4SsS2zkf3WRFACu+qqi9O3/mrONueFtMTJtVozbahuFRfVAwNFOz 4qRw== X-Gm-Message-State: APjAAAWxjDWayHmEhv0fGZJO0vRFVmjXBw2acO2yuETgm4cWXkrEaSOO K/WJ5RRcwmyWnPyAdQSseHB8V3OrB93T74+PDEYHzg== X-Google-Smtp-Source: APXvYqyh5sMUGbMxVuPvLz5LLTUiN20Ox1P2O8TAtX6gV+l9ivQPaUIrJYZWTBXw57EAwIXxziJp+EiENOxx0noPZCA= X-Received: by 2002:aca:efc1:: with SMTP id n184mr19642780oih.121.1555320668081; Mon, 15 Apr 2019 02:31:08 -0700 (PDT) MIME-Version: 1.0 References: <169e228a0f8.c31c5e387288.1776314295744670430@zoho.com> <16a1105e8cc.10a418f3d7674.2191855026893272252@zoho.com> <602658106.3219383.1555226953330@mail.yahoo.com> <16a1f718dd7.eea1cdd916085.1666384883539697922@zoho.com> In-Reply-To: <16a1f718dd7.eea1cdd916085.1666384883539697922@zoho.com> From: =?UTF-8?Q?Stig_Rohde_D=C3=B8ssing?= Date: Mon, 15 Apr 2019 11:30:56 +0200 Message-ID: Subject: Re: How to configure fixed range of ports for (Storm/Netty) internal TCP connections. To: user@storm.apache.org Content-Type: multipart/alternative; boundary="000000000000eed0db05868e4f5f" --000000000000eed0db05868e4f5f Content-Type: text/plain; charset="UTF-8" It would be good to know which commands those Java processes are running. Could you try getting the output of "jps -lvm " for the Java processes that have the ports open? Den man. 15. apr. 2019 kl. 07.21 skrev Thomas Julian : > Hi Roshan, > > Thank you for your reply. What I understand from your reply is that Storm > or its internal components(netty, zeromq etc) won't use any ports or its > ranges for their TCP communication other than ones(6700, 6701, 6702, 6703) > specified in storm.yaml? But in a previous deployment, we observed that > storm uses ports 39855, 35392 to listen for TCP connections. Is this only > possible, when we don't explicitly configure the port numbers for workers? > > > tcp6 0 0 :::39855 :::* LISTEN 9943/java > > tcp6 0 0 :::35392 :::* LISTEN 9521/java > > > Thanks & Regards, > Julian > > > ------------------------------ > > > > > ---- On Sun, 14 Apr 2019 12:59:13 +0530 *Roshan Naik > >* wrote ---- > > > > Julian, > The config `supervisor.slots.ports` is used to control the number of > workers on each Supervisor as well as the range ports on which the workers > should listen for incoming connections. For example, the default config is: > > supervisor.slots.ports > - 6700 > - 6701 > - 6702 > - 6703 > > which means 4 workers per supervisor and each worker should bind to and > listen on one of those 4 ports. > > -roshan > > > > > On Friday, April 12, 2019, 6:09:37 AM EDT, Thomas Julian < > thomasjulian@zoho.com> wrote: > > > > > > Hi, > > Hope the question is clear. Please someone respond or let me know, if the > question is not clear. > > Thanks & Regards, > Julian > > ________________________________ > ---- On Wed, 03 Apr 2019 13:15:07 +0530 Thomas Julian < > thomasjulian@zoho.com> wrote ---- > > > Team, > > > > We have provisioned a distributed storm environment(version:1.2.1) and > noticed that Storm(or netty) uses some random ports to listen for TCP > connections. Can these port(or ranges) be configured, as we do > for supervisor.slots.ports: > > - 6700 > > Ex. > > > > tcp6 0 0 :::39855 :::* LISTEN 9943/java > > tcp6 0 0 :::35392 :::* LISTEN 9521/java > > > > Noted these connections on a supervisor node. We need to configure these > ports in firewall. Please guide! > > > > Thanks & Regards, > > Julian. > > > > > > > --000000000000eed0db05868e4f5f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
It would be good to know which commands those Java process= es are running. Could you try getting the output of "jps -lvm <pid&= gt;" for the Java processes that have the ports open?


Den man. 15. apr. 2019 kl. 07.21 skrev Thomas Julian <thomasjulian@zoho.= com>:
=
Hi Roshan,

Thank you for your rep= ly. What I understand from your reply is that Storm or its internal compone= nts(netty, zeromq etc) won't use any ports or its ranges for their TCP = communication other than ones(6700, 6701, 6702, 6703) specified in storm.ya= ml? But in a previous deployment, we observed that storm uses ports=C2=A039= 855,=C2=A035392 to listen for TCP connections. Is this only possible, when = we don't explicitly configure the port numbers for workers?

> tcp6 0 0 :::39855 :::* LISTEN 9943/java
> tcp6 0 0 :::35392 :::* LISTEN 9521/java

<= div>Thanks & Regards,
Julian=




<= div>
---- On Sun, 14 Apr 2019 12:59:13 +0530 Roshan Naik &l= t;roshan_naik@ya= hoo.com> wrote ----



Julian,
=C2=A0= =C2=A0The config `supervisor.slots.ports` is used to control the number of= workers on each Supervisor as well as the range ports on which the workers= should listen for incoming connections. For example, the default config is= :

supervisor.slots.ports
=C2= =A0- 6700
=C2=A0- 6701
=C2=A0- 6702
=C2=A0- 6703

which means 4 workers per= supervisor and each worker should bind to and listen on one of those 4 por= ts.

-roshan

=


On Friday, April 12, 2019, 6= :09:37 AM EDT, Thomas Julian <thomasjulian@zoho.com> wrote:

<= /div>




H= i,

Hope the question is clear. Please someon= e respond or let me know, if the question is not clear.
Thanks & Regards,
Julian
________________________________
---- On Wed, 03= Apr 2019 13:15:07 +0530 Thomas Julian <thomasjulian@zoho.com> wrote ----

> Team,
>
> = We have provisioned a distributed storm environment(version:1.2.1) and noti= ced that Storm(or netty) uses some random ports to listen for TCP connectio= ns. Can these port(or ranges) be configured, as we do for=C2=A0supervisor.s= lots.ports:
>=C2=A0=C2=A0 - 6700=C2=A0=C2=A0
> Ex.
>
> tcp6 0 0 :::39855 :::* = LISTEN 9943/java
> tcp6 0 0 :::35392 :::* LISTEN 9521/jav= a
>
> Noted these connections on a supe= rvisor node. We need to configure these ports in firewall. Please guide!
>
> Thanks & Regards,
= > Julian.
>


=


--000000000000eed0db05868e4f5f--