beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Sisk (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1040) Hadoop InputFormat - IO Transform for reads
Date Fri, 16 Dec 2016 21:17:58 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755524#comment-15755524
] 

Stephen Sisk commented on BEAM-1040:
------------------------------------

Work is in progress on this. Hoping to have another update mid-january.

> Hadoop InputFormat - IO Transform for reads
> -------------------------------------------
>
>                 Key: BEAM-1040
>                 URL: https://issues.apache.org/jira/browse/BEAM-1040
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-extensions
>            Reporter: Stephen Sisk
>            Assignee: Stephen Sisk
>
> We should build a IO read transform that will read data from services supporting the
Hadoop InputFormat  interface [1]
> This will make it easy to connect to a variety of databases while still providing some
aspects of scalability since the InputFormat interface provides for parallel reading. 
> [1] https://hadoop.apache.org/docs/r2.7.3/api/org/apache/hadoop/mapred/InputFormat.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message