beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Groh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-344) Merge, Split, Delay, and Reorder bundles in the InProcessPipelineRunner
Date Wed, 15 Jun 2016 17:04:09 GMT
Thomas Groh created BEAM-344:
--------------------------------

             Summary: Merge, Split, Delay, and Reorder bundles in the InProcessPipelineRunner
                 Key: BEAM-344
                 URL: https://issues.apache.org/jira/browse/BEAM-344
             Project: Beam
          Issue Type: Improvement
          Components: runner-direct
            Reporter: Thomas Groh
            Assignee: Thomas Groh
            Priority: Minor


PCollections have no guarantees about the ordering of elements between steps

Randomly reordering, splitting and merging bundles will break user pipelines which assume
some order will be maintained between steps and within a bundle. This assumption is not correct,
so should break in the Direct Runner.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message