flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sohimankotia <sohimanko...@gmail.com>
Subject Re: Partitioner is spending around 2 to 4 minutes while pushing data to next operator
Date Thu, 29 Jun 2017 15:42:45 GMT
So , it means when elements leave 

map => sit in buffer (due to partitioner) => enter flatmap 

Since Hbase op in flat map are taking time lets say 1 sec per operation ,
next element will not be read from buffer until HBase Op is done.

Due to this Hbase op , time to enter to flat map from map will get
accumulated for elements waiting in buffer .

Let me know if I understood correctly ?



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Partitioner-is-spending-around-2-to-4-minutes-while-pushing-data-to-next-operator-tp13913p14072.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message