flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Márton Balassi (JIRA) <j...@apache.org>
Subject [jira] [Created] (FLINK-1493) Support for streaming jobs preserving global ordering of records
Date Fri, 06 Feb 2015 16:37:34 GMT
Márton Balassi created FLINK-1493:
-------------------------------------

             Summary: Support for streaming jobs preserving global ordering of records
                 Key: FLINK-1493
                 URL: https://issues.apache.org/jira/browse/FLINK-1493
             Project: Flink
          Issue Type: New Feature
          Components: Streaming
            Reporter: Márton Balassi


Distributed streaming jobs do not give total, global ordering guarantees for records only
partial ordering is provided by the system: records travelling on the same exact route of
the physical plan are ordered, but they aren't between routes.

It turns out that although this feature can only be implemented via "merge sorting" in the
input buffers on a timestamp field thus creating substantial latency is still desired for
a number of applications.

Just a heads up for the implementation: the sorting introduces back pressure in the buffers
and might cause deadlocks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message