storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 이승진 <sweetest...@navercorp.com>
Subject Can I make a bolt to do a batch job?
Date Fri, 11 Jul 2014 08:05:38 GMT
Hi all,
 
Assume that there are one spout and one bolt.
 
and spout emits a single log, and bolt stores it into DB for example.
 
and they are connected using shuffle grouping.
 
It comes to my mind that if a bolt can wait for 10 tuples to come from spout, and request
batch insert to DB, it might be beneficial performancewise.
 
Is there any way to make a bolt gather tuples until certain size and do it's job?
Mime
View raw message