flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Yu <cyu...@gmail.com>
Subject Flink takes 40ms ~ 100ms to proceed from one operator to another?
Date Thu, 20 Sep 2018 13:59:40 GMT
Hi,

My team and I try to measure total time spent on our flink job and found
out that Flink takes 40ms ~ 100ms to proceed from one operator to another.
I wonder how can we reduce this transition time.

Following DAG represents our job:


and here is the screenshot of our log:

at 19:37:04.564, the job is leaving "Source: Custom Source -> Flat Map"
at 19:37:04.605, the job is entering "Co-Flat Map"
at 19:37:04.605, the job is leaving "Co-Flat Map"
at 19:37:04.705, the job is entering "Co-Flat Map -> ...."
at 19:37:04.708, the job is leaving "Co-Flat Map -> ..."

both "Co-Flat Map" finishes merely instantly, while most of the execution
time is spent on the transition. Any idea?


This is a UTF-8 formatted mail
-----------------------------------------------
James C.-C.Yu
+886988713275
+8615618429976

Mime
View raw message