beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Sisk (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-2388) Built-In I/Os page - "discoverability"/"supported with adapters" section
Date Tue, 30 May 2017 19:37:04 GMT
Stephen Sisk created BEAM-2388:
----------------------------------

             Summary: Built-In I/Os page - "discoverability"/"supported with adapters" section
                 Key: BEAM-2388
                 URL: https://issues.apache.org/jira/browse/BEAM-2388
             Project: Beam
          Issue Type: Improvement
          Components: website
            Reporter: Stephen Sisk


>From email discussion: [1]

The recent inclusion of HadoopInputFormatIO (HiFiIO) gave Beam users
the option to ‘easily’ include data stores that support the
Hadoop-based partitioning scheme.  ...  there are visibility issues since end users would
need to repackage and discover the supported (and tested) HiFi-based IOs that won’t be explicit
in the code base.

...

We might add a section to the Built-in IO Transforms page that covers "non-native but readable"
IOs (better name suggestions appreciated :) - that could include a list of data stores that
jdbc/jms/hifio support and link to HIFIO's info on how to use them. (That might also be a
good place to document the performance tradeoffs of using HIFIO)

[1]https://lists.apache.org/thread.html/063b1dee9df43a0ba195c3921dd022b812a4e382be8173e32f84bf66@%3Cdev.beam.apache.org%3E



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message