storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Klausen Schaefersinho <klaus.schaef...@gmail.com>
Subject LocalCluster looses events
Date Wed, 22 Jan 2014 14:40:16 GMT
Hi,

I am developing a topology and I am testing it with a local cluster. I have
one spud and one bolt and they are connected through a field grouping.

I assigned to the spout a parallelization hint of 2 and to the bolt 10.
While I was studying some of my performance logs I found that there are
actually 6 bolts running. Well its just a hint, so it' fine with me. But I
saw also that they a emitting quite a number of events that do not seem to
reach bolt. The spouts have a sleep inside, so you can see that
DMSInputBolt.I_1 and DMSInputBolt.I_2 are really invoked and the sum of
their events sums up correctly to the sum of events in the worker. My
questions is now, what are the other spouits doing, and what where do their
events do?


 Component                            | # Events     | Ev / Sec     |
Time(s)      | Time(%)
 -------------------------------------+--------------+--------------+--------------+--------------
  RecommendationBolt                  | 968          | 20           | 1.53
        | 2.0%
  DMSInputBolt                        | 2902         | 60           | 97.25
       | 98.0%



 Component.Instance                   | # Events     | Ev / Sec     |
Time(s)      | Time(%)
 -------------------------------------+--------------+--------------+--------------+--------------
  RecommendationBolt.I_13             | 85           | 2            | 0.1
       | 0.0%
  RecommendationBolt.I_12             | 89           | 2            | 0.1
       | 0.0%
  RecommendationBolt.I_14             | 93           | 2            | 0.11
        | 0.0%
  RecommendationBolt.I_8              | 95           | 2            | 0.12
        | 0.0%
  RecommendationBolt.I_9              | 96           | 2            | 0.11
        | 0.0%
  RecommendationBolt.I_11             | 97           | 2            | 0.11
        | 0.0%
  RecommendationBolt.I_7              | 98           | 2            | 0.11
        | 0.0%
  RecommendationBolt.I_15             | 99           | 2            | 0.11
        | 0.0%
  RecommendationBolt.I_16             | 103          | 2            | 0.55
        | 1.0%
  RecommendationBolt.I_10             | 113          | 2            | 0.12
        | 0.0%
  DMSInputBolt.I_3                    | 482          | 10           | 0.05
        | 0.0%
  DMSInputBolt.I_1                    | 482          | 10           | 48.44
       | 49.0%
  DMSInputBolt.I_6                    | 483          | 10           | 0.03
        | 0.0%
  DMSInputBolt.I_2                    | 484          | 10           | 48.65
       | 49.0%
  DMSInputBolt.I_5                    | 485          | 10           | 0.03
        | 0.0%
  DMSInputBolt.I_4                    | 486          | 10           | 0.05
        | 0.0%


If this is just an issue of the LocalCluster I won't mind any more...

Best Regards,


Klaus

Mime
View raw message