beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Sisk (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-1171) Source.getDefaultOutputCoder() - add a version that allows access to a CoderRegistry
Date Fri, 16 Dec 2016 20:59:58 GMT
Stephen Sisk created BEAM-1171:
----------------------------------

             Summary: Source.getDefaultOutputCoder() - add a version that allows access to
a CoderRegistry
                 Key: BEAM-1171
                 URL: https://issues.apache.org/jira/browse/BEAM-1171
             Project: Beam
          Issue Type: Bug
          Components: beam-model, sdk-java-core
            Reporter: Stephen Sisk
            Assignee: Stephen Sisk


The Source API's getDefaultOutputCoder currently takes no parameters. This means that you
can't access the coder registry to ask for coders based on the type.

The PTransform API's version of getDefaultOutputCoder has 3 different form, which do allow
access to the coder registry if necessary.

However, while working on BEAM-1040 (Hadoop IO connector), we realized that a source does
not always know it's output type, and thus will need to calculate the coder at run time. To
do this, it would be helpful to have a reference to the CoderRegistry - we should look at
what we're doing on PTransform and decide if we should port that over onto Source.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message