Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A03EE10406 for ; Tue, 7 Jan 2014 22:15:53 +0000 (UTC) Received: (qmail 60895 invoked by uid 500); 7 Jan 2014 22:15:53 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 60858 invoked by uid 500); 7 Jan 2014 22:15:53 -0000 Mailing-List: contact user-help@storm.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.incubator.apache.org Delivered-To: mailing list user@storm.incubator.apache.org Received: (qmail 60850 invoked by uid 99); 7 Jan 2014 22:15:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Jan 2014 22:15:53 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ptgoetz@gmail.com designates 209.85.220.52 as permitted sender) Received: from [209.85.220.52] (HELO mail-pa0-f52.google.com) (209.85.220.52) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Jan 2014 22:15:48 +0000 Received: by mail-pa0-f52.google.com with SMTP id ld10so971840pab.39 for ; Tue, 07 Jan 2014 14:15:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:message-id:mime-version:subject:date:references :to:in-reply-to; bh=0SNRBeOx6vh+xDa12aboTvk4St3oFlgRI40mDcH2HWk=; b=MuSkDaDp/9rqJq1XsasSMqxoI5e8mhw1dWhzUgtrJ3m+uDg+UkUuB6f2m9Rj5kqtLG hSvvhZ+KUomb4LDGyy2GwPSgzcfDtzDayv0h1l3JmgH7tzIio9DJNyevZ/p33l5f2uQp H2qDc2HqSpwXxttseuuN9cDKYS6kUsER+8GBReAYtYOJF+Y4yOiZ2DWfhbveeUj1vtIa r6bC6PB45ZA4ypcgngZ4lzfkNN3lSal1vxp9WQeZFsQ+WdAENi5YfkqklSjdY1B9lM4r uXIUr6gYQK1s6vyefaVGtYeu+XO1lIPVtWmdEUEaMKLEws6UgDmEZ1AV7ywpO4aLMZlw CgXw== X-Received: by 10.66.180.200 with SMTP id dq8mr8268078pac.104.1389132928003; Tue, 07 Jan 2014 14:15:28 -0800 (PST) Received: from [10.11.3.89] ([192.175.27.2]) by mx.google.com with ESMTPSA id sx8sm181120389pab.5.2014.01.07.14.15.25 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 07 Jan 2014 14:15:26 -0800 (PST) From: "P. Taylor Goetz" Content-Type: multipart/signed; boundary="Apple-Mail=_DF2A77BB-2635-4E1E-8E06-FC1C3AB02E2A"; protocol="application/pgp-signature"; micalg=pgp-sha512 Message-Id: <20E2C3FA-850B-48FE-B1E4-9A34C0E35F1C@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\)) Subject: Re: Is it possible to find out the active supervisor nodes through a program? Date: Tue, 7 Jan 2014 14:15:21 -0800 References: To: user@storm.incubator.apache.org In-Reply-To: X-Mailer: Apple Mail (2.1827) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_DF2A77BB-2635-4E1E-8E06-FC1C3AB02E2A Content-Type: multipart/alternative; boundary="Apple-Mail=_D9592CE1-82D9-4FE7-B172-2E1B92423139" --Apple-Mail=_D9592CE1-82D9-4FE7-B172-2E1B92423139 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Richards, Yes, the Nimbus thrift interface provides an API for querying a Storm = cluster, and is exactly what Storm UI uses to get the information it = displays.=20 As far as =93active=94 supervisors, it depends on what you mean by = =93active=94. If by active you mean =93up and known to Nimbus=94 then = the list returned by the thrift API should be enough, if you mean =93has = active worker processes=94 then you=92ll have to do additional work (not = much) to see if it has any used slots. HTH - Taylor On Jan 7, 2014, at 3:50 AM, Richards Peter = wrote: > Hi, >=20 > I would like to know whether we can find out the list of active storm = supervisor nodes? I checked the following class: >=20 > = https://github.com/apache/incubator-storm/blob/master/storm-core/src/jvm/b= acktype/storm/generated/Nimbus.java >=20 > It has a method -> getClusterInfo():ClusterSummary >=20 >=20 > ClusterSummary internally has another method -> = get_supervisors():List >=20 > = https://github.com/apache/incubator-storm/blob/master/storm-core/src/jvm/b= acktype/storm/generated/SupervisorSummary.java >=20 > Will this be able to tell me the list of all active supervisors? I = would like to ignore the supervisors which are not active at the = present. Is there a better way to achieve the same? >=20 > Thanks, > Richards Peter. --Apple-Mail=_D9592CE1-82D9-4FE7-B172-2E1B92423139 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 Richards,

Yes, the Nimbus thrift = interface provides an API for querying a Storm cluster, and is exactly = what Storm UI uses to get the information it = displays. 

As far as =93active=94 = supervisors, it depends on what you mean by =93active=94. If by active = you mean =93up and known to Nimbus=94 then the list returned by the = thrift API should be enough, if you mean =93has active worker processes=94= then you=92ll have to do additional work (not much) to see if it has = any used slots.

HTH

- = Taylor


On Jan 7, 2014, = at 3:50 AM, Richards Peter <hbkrichards@gmail.com> = wrote:

Hi,

I= would like to know whether we can find out the list of active storm = supervisor nodes? I checked the following class:

https://github.com/apache/inc= ubator-storm/blob/master/storm-core/src/jvm/backtype/storm/generated/Nimbu= s.java

It has a method -> getClusterInfo():ClusterSummary


ClusterSummary = internally has another method -> get_supervisors():List<SupervisorSummary>

https://github.com= /apache/incubator-storm/blob/master/storm-core/src/jvm/backtype/storm/gene= rated/SupervisorSummary.java

Will this be able to tell me the list = of all active supervisors? I would like to ignore the supervisors which = are not active at the present. Is there a better way to achieve the = same?

Thanks,
Richards = Peter.

= --Apple-Mail=_D9592CE1-82D9-4FE7-B172-2E1B92423139-- --Apple-Mail=_DF2A77BB-2635-4E1E-8E06-FC1C3AB02E2A Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJSzHx5AAoJEI3gOWLoC4/94GQH/iIjn88nqG/PT4tDjpQVwxoi JJFxfGSKSrb/tu7oYMaf8ZYHpV2tWXh5zhruv1gQcx3LsI4g1vfjHKFfUUiGfHof LcaWdEUobjB3hqBZXUI4jAzB4gyWNB1oAmoPJpSdm/U3mCpQgyU658fxxkV39IaS WpGTBPGz+eM42am3oy1RASH2JwQTJp/tELnoChQ0lWPq1kqBQg4WCjxauHxQYRa/ +bIJ7HHr9P1bRL5SbB5QA0B3j4UK/UB3UJPx98Uk8ehpgCMaoXjsPpivds/dJmpp VZjf2UKQj9yu6quCCq6V2fHnkp9IUdghcWgBRpHeW2Tdwe8dl3VDvmGdZexZ+So= =lR9g -----END PGP SIGNATURE----- --Apple-Mail=_DF2A77BB-2635-4E1E-8E06-FC1C3AB02E2A--