beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chamikaramj <...@git.apache.org>
Subject [GitHub] incubator-beam pull request #1235: [BEAM-700] Improvements related to size e...
Date Mon, 31 Oct 2016 14:45:47 GMT
GitHub user chamikaramj opened a pull request:

    https://github.com/apache/incubator-beam/pull/1235

    [BEAM-700] Improvements related to size estimation.

    Updates FileBasedSource so that size estimation of glob patterns that expand into a large
number of files is done using sampling.
    
    Updates Dataflow runner to set estimated sizes of sources when submitting jobs.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/chamikaramj/incubator-beam estimate_size_of_sources

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/1235.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1235
    
----
commit 42b1d9f541a54ea49ec717934632e8e82c21e911
Author: chamikara@google.com <chamikara@google.com>
Date:   2016-10-31T14:39:13Z

    Improvements related to size estimation.
    
    Updates FileBasedSource so that size estimation of glob patterns that expand into a large
number of files is done using sampling.
    
    Updates Dataflow runner to set estimated sizes of sources when submitting jobs.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message