flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shangan Chen <chenshangan...@gmail.com>
Subject It's quite inefficient taking event from memory channel one by one
Date Thu, 24 Apr 2014 06:36:28 GMT
I record the overall time in different stages in HDFSEventSink#process() ,
take events from channel always cost the most time dealing with a batch of
events. And I found it take one event from channel each time, so I wonder
whether it will be much faster if we take a batch of events from channel
each time ?

have a good day!

View raw message