beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Sisk (JIRA)" <>
Subject [jira] [Created] (BEAM-2388) Built-In I/Os page - "discoverability"/"supported with adapters" section
Date Tue, 30 May 2017 19:37:04 GMT
Stephen Sisk created BEAM-2388:

             Summary: Built-In I/Os page - "discoverability"/"supported with adapters" section
                 Key: BEAM-2388
             Project: Beam
          Issue Type: Improvement
          Components: website
            Reporter: Stephen Sisk

>From email discussion: [1]

The recent inclusion of HadoopInputFormatIO (HiFiIO) gave Beam users
the option to ‘easily’ include data stores that support the
Hadoop-based partitioning scheme.  ...  there are visibility issues since end users would
need to repackage and discover the supported (and tested) HiFi-based IOs that won’t be explicit
in the code base.


We might add a section to the Built-in IO Transforms page that covers "non-native but readable"
IOs (better name suggestions appreciated :) - that could include a list of data stores that
jdbc/jms/hifio support and link to HIFIO's info on how to use them. (That might also be a
good place to document the performance tradeoffs of using HIFIO)


This message was sent by Atlassian JIRA

View raw message