beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <>
Subject [jira] [Created] (BEAM-70) More expressive UnboundedSource hierarchy and utilities
Date Thu, 25 Feb 2016 17:07:18 GMT
Daniel Halperin created BEAM-70:

             Summary: More expressive UnboundedSource hierarchy and utilities
                 Key: BEAM-70
             Project: Beam
          Issue Type: New Feature
          Components: sdk-java-core
            Reporter: Daniel Halperin

Right now, the UnboundedSource type hierarchy is 1 deep -- UnboundedSource and then things
like CountingSource or KafkaSource directly on top.

To ease implementors, we should have more abstract classes in the "common source types". Some
examples may be:

- KeyRangeUnboundedSource -- for things like PubSub, Bigtable, Kafka, Kinesis
- StreamSource -- for reading from a socket or other stream.

This message was sent by Atlassian JIRA

View raw message