storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hannum, Daniel" <Daniel_Han...@PremierInc.com>
Subject Re: Can I emit a Map?
Date Tue, 21 Nov 2017 20:48:13 GMT
I forget where I read it, but I was told that there is no de jure size limit on tuples. My
topology will have tuples 1M in size, and outliers much larger than that. I haven’t seen
any issues. Obviously at some point, you run out of memory…. ☺

From: Marco Costantini <mcsilvio@gmail.com>
Reply-To: "user@storm.apache.org" <user@storm.apache.org>
Date: Tuesday, November 21, 2017 at 3:39 PM
To: "user@storm.apache.org" <user@storm.apache.org>
Subject: Re: Can I emit a Map?

****This email did not originate from the Premier, Inc. network. Use caution when opening
attachments or clicking on URLs.*****


.
Thanks. What if it's big? My Strings end up being a couple thousand characters long, and each
map has around 500 of them. Seems daunting to emit such a tuple. Any thoughts on that?

On Tue, Nov 21, 2017 at 7:23 PM, Stig Rohde Døssing <srdo@apache.org<mailto:srdo@apache.org>>
wrote:
I think that as long as you ensure that everything in the map can be serialized, it's fine.

2017-11-21 18:31 GMT+01:00 Marco Costantini <mcsilvio@gmail.com<mailto:mcsilvio@gmail.com>>:
I have a batching bolt which ultimately makes a Map<String, Set<String>>. At a
time I decide, I need to emit that map to the next bolt in the topology. I've tried it and
it works, but I'm curious as to whether this is an anti-pattern or if there are problems with
doing this that I am unaware of.

Please and thanks,
Marco.


Mime
View raw message