beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner
Date Wed, 24 May 2017 22:16:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023791#comment-16023791
] 

ASF GitHub Bot commented on BEAM-1542:
--------------------------------------

GitHub user mairbek opened a pull request:

    https://github.com/apache/beam/pull/3221

    [BEAM-1542] SpannerIO sink updates

    Unit and integration test.
    Logical mutation size estimation.
    
    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`.
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
    
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mairbek/beam mergespanner

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3221.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3221
    
----
commit 8db6693c34712c899a1655d5305f2602a9120e9b
Author: MOLIG004 <guy.molinari@disney.com>
Date:   2017-05-04T16:21:23Z

    Initial implementation of SpannerIO.Write
    
    This closes #2166.

commit 491f047726ec2146a634a870efa4a43b9d4d643d
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-04T17:42:07Z

    Minor style, compilation, javadoc fixups

commit 7a2d09a0d2783f074348d9b8a1f5bbab7e0a2871
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-04T17:48:24Z

    SpannerCSVLoader: update for TextIO API Change

commit 77be2762825def0c9a62c30b02b9d0a8ff2a15f2
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-04T17:48:54Z

    Fix spanner dependency management
    
    Also minor cleanup alphabetization in root pom.xml

commit 4049047a38bd5dfa6facee8f3c68086c81873e91
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-12T19:59:27Z

    Introduced MutationSizeEstimator.

commit 4392de9be272c045a9854340f887e420f25f0f4a
Author: MOLIG004 <guy.molinari@disney.com>
Date:   2017-05-04T16:21:23Z

    Initial implementation of SpannerIO.Write
    
    This closes #2166.

commit b092be8df5cd96012c4d67b3defbd3554707edfe
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-04T17:42:07Z

    Minor style, compilation, javadoc fixups

commit e16339a3e699d7bea30f3f3a703b4c7c3ead0f59
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-04T17:48:54Z

    Fix spanner dependency management
    
    Also minor cleanup alphabetization in root pom.xml

commit 9798534793286aeb3deacdc0e30f63032b6077fe
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-04T17:48:24Z

    Delete SpannerCSVLoader
    
    This is not appropriate for examples. SpannerIO should be well-javadoced
    and integration tested.

commit f495a414d6d6ec1a3098fb751f499680d070f7c5
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-15T17:16:18Z

    Refine Spanner API tests
    
    And remove outdated Bigtable comment

commit ce5d04cc354c3d1bd3938eff94aa3474adac1e1b
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-15T17:42:57Z

    SpannerIO.Write cleanup and style fixes
    
    * Rename to Write to match the rest of the SDK.
    * Convert to AutoValue, delete toString.
    * Drop .writeTo(), instead use .write() as default constructor.
    * Temporarily drop withBatchSize, as its existence is not clearly
      justified.

commit 81e71f62c8c0ba2eb1f5b7e8240650539785fa52
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-15T18:20:18Z

    Merge branch 'takeover-2166' of https://github.com/dhalperi/beam into mergespanner
    
    # Conflicts:
    #	sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.java
    #	sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/GcpApiSurfaceTest.java

commit 16e4b832628205b1f560e5f37fb105d17f2b56ec
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-15T18:38:44Z

    Use a new batch size limit.

commit 5a2214a2623fa6d8d4a7b50852b59dc7789837af
Author: Dan Halperin <dhalperi@google.com>
Date:   2017-05-15T17:42:57Z

    SpannerIO.Write cleanup and style fixes
    
    * Rename to Write to match the rest of the SDK.
    * Convert to AutoValue, delete toString.
    * Drop .writeTo(), instead use .write() as default constructor.
    * Temporarily drop withBatchSize, as its existence is not clearly
      justified.

commit 5fc07fe297f6cf5fdd00bb3385d6a23baaf67104
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-15T21:59:22Z

    Added a SpannerIO unit test.

commit 0b7b84dfbe17cbc0747197f34c8512610d01d86e
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-15T23:25:33Z

    Renaming and documenting

commit 2b5a10e7b64148db2bbcfadbef81dee7c0e10347
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-15T23:56:23Z

    Reorganized test.
    Better formatting

commit 938b92c71368e0f2334b264de4e1e218bf96eb41
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-16T00:06:59Z

    Merge remote-tracking branch 'dhalperi/takeover-2166' into mergespanner
    
    Resolved merge

commit fd2a76cf8b4fe31be3f7e665e11affe2602cf6a9
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-16T00:09:37Z

    Pre PR cleanup

commit e24254c2d1d82638b76347a473a46acfef768845
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-16T01:09:44Z

    Sketch out integration test

commit 34c7c6f378d19a2c528954c3d20780921e9461dc
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-16T01:40:21Z

    End to end test for Cloud Spanner Sink

commit f30b520159df45592f98ef7371e9a099c37472bd
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-16T06:27:13Z

    Make checkstyle happy

commit 060ff58bba93ef01b7c5b4cb38e82ca4f4be23b8
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-24T21:57:24Z

    Merge branch 'master' of https://github.com/apache/beam into mergespanner
    
    # Conflicts:
    #	pom.xml
    #	sdks/java/io/google-cloud-platform/pom.xml
    #	sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.java

commit 1f256efd78af37f9860cbc8fa32a7732adeb23bf
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-24T21:57:35Z

    Merge branch 'master' of https://github.com/apache/beam into mergespanner
    
    # Conflicts:
    #	pom.xml
    #	sdks/java/io/google-cloud-platform/pom.xml
    #	sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerIO.java

commit dabda8d1fe8f8ca7b09c6f3a48262fae24c29dc9
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-24T22:03:09Z

    Revert style change

commit cf6e8175d755c7498f06ffd51db749f6ddbc98a4
Author: Mairbek Khadikov <mairbek@google.com>
Date:   2017-05-24T22:12:24Z

    Revert style change

----


> Need Source/Sink for Spanner
> ----------------------------
>
>                 Key: BEAM-1542
>                 URL: https://issues.apache.org/jira/browse/BEAM-1542
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-java-gcp
>            Reporter: Guy Molinari
>            Assignee: Mairbek Khadikov
>
> Is there a source/sink for Spanner in the works?   If not I would gladly give this a
shot.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message