flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aljoscha Krettek <aljos...@apache.org>
Subject Re: Partitioner is spending around 2 to 4 minutes while pushing data to next operator
Date Thu, 29 Jun 2017 16:13:58 GMT
Yes, this is exactly right!

> On 29. Jun 2017, at 17:42, sohimankotia <sohimankotia@gmail.com> wrote:
> 
> So , it means when elements leave 
> 
> map => sit in buffer (due to partitioner) => enter flatmap 
> 
> Since Hbase op in flat map are taking time lets say 1 sec per operation ,
> next element will not be read from buffer until HBase Op is done.
> 
> Due to this Hbase op , time to enter to flat map from map will get
> accumulated for elements waiting in buffer .
> 
> Let me know if I understood correctly ?
> 
> 
> 
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Partitioner-is-spending-around-2-to-4-minutes-while-pushing-data-to-next-operator-tp13913p14072.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.


Mime
View raw message