Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2F49410AAB for ; Wed, 22 Jan 2014 14:40:44 +0000 (UTC) Received: (qmail 32197 invoked by uid 500); 22 Jan 2014 14:40:43 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 32027 invoked by uid 500); 22 Jan 2014 14:40:43 -0000 Mailing-List: contact user-help@storm.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.incubator.apache.org Delivered-To: mailing list user@storm.incubator.apache.org Received: (qmail 32019 invoked by uid 99); 22 Jan 2014 14:40:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jan 2014 14:40:42 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of klaus.schaefers@gmail.com designates 74.125.82.180 as permitted sender) Received: from [74.125.82.180] (HELO mail-we0-f180.google.com) (74.125.82.180) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jan 2014 14:40:37 +0000 Received: by mail-we0-f180.google.com with SMTP id q59so375723wes.25 for ; Wed, 22 Jan 2014 06:40:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=GjO6Hdc1mswQbOO4EUwtBIApjlqYX3U1VNwupbRfamE=; b=PPhBlZE+dDVp1ajK+Dx+kCkOdOoHx4e34NzWgioIIRclrc2wGj7yS9/Mee7vPSlX4+ gXKppWcIW2Idgh1MZX2cjcAJu5OynlH3caKX+M785bNVJSaj89v5EFVExY7Ud/K5ODTm QBK9BS9kmhp6y0f+pDslwDcMRNhepPnzM7HHG11PlKAImsNfZkbKWEQ+Fzwx+nTkKFoX T9jub9zE3IDXWwTwiMo8u2zp3qUXFrf+69c2EBGS6FY9HVe1eaOR5A+AnmGB6mNnGRGl jjLmB1Y/a4OSuSoW7/ldoT0LwRI2CDRbF9B0d+g0f2HYxpx+k/PIlB6gH4VQWhIlQYTL XNow== MIME-Version: 1.0 X-Received: by 10.194.60.103 with SMTP id g7mr2100231wjr.37.1390401616414; Wed, 22 Jan 2014 06:40:16 -0800 (PST) Received: by 10.180.97.131 with HTTP; Wed, 22 Jan 2014 06:40:16 -0800 (PST) Date: Wed, 22 Jan 2014 15:40:16 +0100 Message-ID: Subject: LocalCluster looses events From: Klausen Schaefersinho To: user@storm.incubator.apache.org Content-Type: multipart/alternative; boundary=047d7b86cfbc710d2004f0901a68 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b86cfbc710d2004f0901a68 Content-Type: text/plain; charset=ISO-8859-1 Hi, I am developing a topology and I am testing it with a local cluster. I have one spud and one bolt and they are connected through a field grouping. I assigned to the spout a parallelization hint of 2 and to the bolt 10. While I was studying some of my performance logs I found that there are actually 6 bolts running. Well its just a hint, so it' fine with me. But I saw also that they a emitting quite a number of events that do not seem to reach bolt. The spouts have a sleep inside, so you can see that DMSInputBolt.I_1 and DMSInputBolt.I_2 are really invoked and the sum of their events sums up correctly to the sum of events in the worker. My questions is now, what are the other spouits doing, and what where do their events do? Component | # Events | Ev / Sec | Time(s) | Time(%) -------------------------------------+--------------+--------------+--------------+-------------- RecommendationBolt | 968 | 20 | 1.53 | 2.0% DMSInputBolt | 2902 | 60 | 97.25 | 98.0% Component.Instance | # Events | Ev / Sec | Time(s) | Time(%) -------------------------------------+--------------+--------------+--------------+-------------- RecommendationBolt.I_13 | 85 | 2 | 0.1 | 0.0% RecommendationBolt.I_12 | 89 | 2 | 0.1 | 0.0% RecommendationBolt.I_14 | 93 | 2 | 0.11 | 0.0% RecommendationBolt.I_8 | 95 | 2 | 0.12 | 0.0% RecommendationBolt.I_9 | 96 | 2 | 0.11 | 0.0% RecommendationBolt.I_11 | 97 | 2 | 0.11 | 0.0% RecommendationBolt.I_7 | 98 | 2 | 0.11 | 0.0% RecommendationBolt.I_15 | 99 | 2 | 0.11 | 0.0% RecommendationBolt.I_16 | 103 | 2 | 0.55 | 1.0% RecommendationBolt.I_10 | 113 | 2 | 0.12 | 0.0% DMSInputBolt.I_3 | 482 | 10 | 0.05 | 0.0% DMSInputBolt.I_1 | 482 | 10 | 48.44 | 49.0% DMSInputBolt.I_6 | 483 | 10 | 0.03 | 0.0% DMSInputBolt.I_2 | 484 | 10 | 48.65 | 49.0% DMSInputBolt.I_5 | 485 | 10 | 0.03 | 0.0% DMSInputBolt.I_4 | 486 | 10 | 0.05 | 0.0% If this is just an issue of the LocalCluster I won't mind any more... Best Regards, Klaus --047d7b86cfbc710d2004f0901a68 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

I am developing a topol= ogy and I am testing it with a local cluster. I have one spud and one bolt = and they are connected through a field grouping.

I assigned to the spout a parallelization hint of 2 and to the bolt 10. Wh= ile I was studying some of my performance logs I found that there are actua= lly 6 bolts running. Well its just a hint, so it' fine with me. But I s= aw also that they a emitting quite a number of events that do not seem to r= each bolt. The spouts have a sleep inside, so you can see that DMSInputBolt= .I_1 and DMSInputBolt.I_2 are really invoked and the sum of their events su= ms up correctly to the sum of events in=A0the=A0worker. My questions is now= , what are the=A0other=A0spouits doing,=A0and what where do their events do= ?=A0


=A0Component =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| # = Events =A0 =A0 | Ev / Sec =A0 =A0 | Time(s) =A0 =A0 =A0| Time(%) =A0 =A0=A0=
=A0-----------------------------= --------+--------------+--------------+--------------+--------------=
=A0 RecommendationBolt =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| 968 =A0 =A0 =A0 =A0 =A0| 20 =A0 =A0 =A0 = =A0 =A0 | 1.53 =A0 =A0 =A0 =A0 | 2.0% =A0 =A0 =A0 =A0
=A0 DMSInputBolt =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| 2902 =A0 =A0 =A0 =A0 | 60 =A0 =A0 =A0 =A0= =A0 | 97.25 =A0 =A0 =A0 =A0| 98.0% =A0 =A0 =A0=A0



=A0Component.Instance =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 | # E= vents =A0 =A0 | Ev / Sec =A0 =A0 | Time(s) =A0 =A0 =A0| Time(%) =A0 =A0=A0<= /font>
=A0-----------------= --------------------+--------------+--------------+--------------+---------= -----
=A0 RecommendationBolt.I_13 =A0 = =A0 =A0 =A0 =A0 =A0 | 85 =A0 =A0 =A0 =A0 =A0 | 2 =A0 =A0 =A0 =A0 =A0 =A0| 0= .1 =A0 =A0 =A0 =A0 =A0| 0.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_12 =A0 =A0 =A0 =A0 =A0 = =A0 | 89 =A0 =A0 =A0 =A0 =A0 | 2 =A0 =A0 =A0 =A0 =A0 =A0| 0.1 =A0 =A0 =A0 = =A0 =A0| 0.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_14 =A0 = =A0 =A0 =A0 =A0 =A0 | 93 =A0 =A0 =A0 =A0 =A0 | 2 =A0 =A0 =A0 =A0 =A0 =A0| 0= .11 =A0 =A0 =A0 =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_8 =A0 =A0 =A0 =A0 =A0 =A0 = =A0| 95 =A0 =A0 =A0 =A0 =A0 | 2 =A0 =A0 =A0 =A0 =A0 =A0| 0.12 =A0 =A0 =A0 = =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_9 =A0 = =A0 =A0 =A0 =A0 =A0 =A0| 96 =A0 =A0 =A0 =A0 =A0 | 2 =A0 =A0 =A0 =A0 =A0 =A0= | 0.11 =A0 =A0 =A0 =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_11 =A0 =A0 =A0 =A0 =A0= =A0 | 97 =A0 =A0 =A0 =A0 =A0 | 2 =A0 =A0 =A0 =A0 =A0 =A0| 0.11 =A0 =A0 =A0= =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_7 =A0 = =A0 =A0 =A0 =A0 =A0 =A0| 98 =A0 =A0 =A0 =A0 =A0 | 2 =A0 =A0 =A0 =A0 =A0 =A0= | 0.11 =A0 =A0 =A0 =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_15 =A0 =A0 =A0 =A0 =A0= =A0 | 99 =A0 =A0 =A0 =A0 =A0 | 2 =A0 =A0 =A0 =A0 =A0 =A0| 0.11 =A0 =A0 =A0= =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_16 =A0 = =A0 =A0 =A0 =A0 =A0 | 103 =A0 =A0 =A0 =A0 =A0| 2 =A0 =A0 =A0 =A0 =A0 =A0| 0= .55 =A0 =A0 =A0 =A0 | 1.0% =A0 =A0 =A0 =A0
=A0 RecommendationBolt.I_10 =A0 =A0 =A0 =A0 =A0 =A0 = | 113 =A0 =A0 =A0 =A0 =A0| 2 =A0 =A0 =A0 =A0 =A0 =A0| 0.12 =A0 =A0 =A0 =A0 = | 0.0% =A0 =A0 =A0 =A0
=A0 DMSInputBo= lt.I_3 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| 482 =A0 =A0 =A0 =A0 =A0| 10= =A0 =A0 =A0 =A0 =A0 | 0.05 =A0 =A0 =A0 =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 DMSInp= utBolt.I_1 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| 482 =A0 =A0 =A0 =A0 =A0= | 10 =A0 =A0 =A0 =A0 =A0 | 48.44 =A0 =A0 =A0 =A0| 49.0% =A0 =A0 =A0=A0
=A0 DMSInputBo= lt.I_6 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| 483 =A0 =A0 =A0 =A0 =A0| 10= =A0 =A0 =A0 =A0 =A0 | 0.03 =A0 =A0 =A0 =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 DMSInp= utBolt.I_2 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| 484 =A0 =A0 =A0 =A0 =A0= | 10 =A0 =A0 =A0 =A0 =A0 | 48.65 =A0 =A0 =A0 =A0| 49.0% =A0 =A0 =A0=A0
=A0 DMSInputBo= lt.I_5 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| 485 =A0 =A0 =A0 =A0 =A0| 10= =A0 =A0 =A0 =A0 =A0 | 0.03 =A0 =A0 =A0 =A0 | 0.0% =A0 =A0 =A0 =A0
=A0 DMSInp= utBolt.I_4 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0| 486 =A0 =A0 =A0 =A0 =A0= | 10 =A0 =A0 =A0 =A0 =A0 | 0.05 =A0 =A0 =A0 =A0 | 0.0% =A0 =A0 =A0 =A0

If this is just an issue of the LocalCluste= r I won't mind any more...

Best Regards,


Klaus
--047d7b86cfbc710d2004f0901a68--