beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-2656) Introduce AvroIO.readAll()
Date Fri, 21 Jul 2017 21:17:00 GMT


ASF GitHub Bot commented on BEAM-2656:

GitHub user jkff opened a pull request:

    [BEAM-2656] Introduces AvroIO.readAll()

    This includes a couple more improvements:
    - Adding ValueProvider support to
    - Creating a common utility transform for reading a collection of filepatterns via FileBasedSource.
I did not make it public because it should bake some more with other use cases.
    R: @jbonofre 
    CC: @reuvenlax 

You can merge this pull request into a Git repository by running:

    $ git pull avroio-readall

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3615
commit 0824e3982bd47f54b917da250497923049d23ca9
Author: Eugene Kirpichov <>
Date:   2017-07-21T19:38:17Z

    Adds ValueProvider support to AvroIO.Read

commit f988deb238178e28227443b5e8fc389c96f907cf
Author: Eugene Kirpichov <>
Date:   2017-07-21T21:09:13Z

    Extracts common logic from TextIO.ReadAll into a utility transform

commit 7345de77b2fa658970addfddc21fecaf57dc3775
Author: Eugene Kirpichov <>
Date:   2017-07-21T21:09:35Z

    Introduces AvroIO.readAll() and readAllGenericRecords()


> Introduce AvroIO.readAll()
> --------------------------
>                 Key: BEAM-2656
>                 URL:
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>            Reporter: Eugene Kirpichov
>            Assignee: Eugene Kirpichov
> TextIO.readAll() is nifty and performant when reading a large number of files.
> We should similarly have AvroIO.readAll(). Maybe other connectors too in the future.

This message was sent by Atlassian JIRA

View raw message