beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Sisk (JIRA)" <>
Subject [jira] [Resolved] (BEAM-1026) User guide - "How to create Beam IO Transforms"
Date Tue, 22 Nov 2016 01:29:02 GMT


Stephen Sisk resolved BEAM-1026.
       Resolution: Duplicate
    Fix Version/s: Not applicable

> User guide - "How to create Beam IO Transforms"
> -----------------------------------------------
>                 Key: BEAM-1026
>                 URL:
>             Project: Beam
>          Issue Type: Task
>            Reporter: Stephen Sisk
>             Fix For: Not applicable
> Beam has javadocs for how to create a read or write transform, but no friendly user guide
on how to get started using BoundedSource/BoundedReader.
> This should cover:
> * background on beam's source/sink API design 
> * design patterns
> * evaluating different data sources (eg, what are the properties of a pub sub system
that affect how you should write your UnboundedSource? What is the best design for reading
from a NoSql style source?)
> * testing - how to write unit, integration (and once we have them, performance tests)
> * public API recommendations
> This is related, but not strictly overlapping with: 
> - the Dataflow SDK documentation for "Custom Sources and Sinks"  contains some info about
writing Sources/Sinks, but it is somewhat out of date, and doesn't reflect the things we've
learned recently.

This message was sent by Atlassian JIRA

View raw message