beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Groh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-3859) Add an override to read from an Unbounded Source via Impulse and ParDo
Date Thu, 15 Mar 2018 18:56:00 GMT
Thomas Groh created BEAM-3859:
---------------------------------

             Summary: Add an override to read from an Unbounded Source via Impulse and ParDo
                 Key: BEAM-3859
                 URL: https://issues.apache.org/jira/browse/BEAM-3859
             Project: Beam
          Issue Type: Bug
          Components: runner-core
            Reporter: Thomas Groh


This enables more movement towards BEAM-2421.

 

The DoFn that implements an UnboundedRead will have to be performed by a Splittable DoFn,
as otherwise a reader can (and likely will) produce unbounded output per split, and cannot
properly hold watermarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message