beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vikas Kedigehalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-354) Modify DatastoreIO to use Datastore v1beta3 API
Date Thu, 16 Jun 2016 21:15:05 GMT

    [ https://issues.apache.org/jira/browse/BEAM-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334704#comment-15334704
] 

Vikas Kedigehalli commented on BEAM-354:
----------------------------------------

I propose to implement this in phases (as small well-defined Pull Requests). Roughly outlining
the steps here,

1. Modify DatastoreIO to use the v1beta3 API and update tests&examples to reflect the
changes. 
2. Add PTransforms, DatastoreIO.V1Beta3.Read and .Write and wrap the DatastoreIO Source/Sink.
Modify examples accordingly
3. Add end-to-end tests, add more documentation, validate maven dependencies etc.

> Modify DatastoreIO to use Datastore v1beta3 API
> -----------------------------------------------
>
>                 Key: BEAM-354
>                 URL: https://issues.apache.org/jira/browse/BEAM-354
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-gcp
>            Reporter: Vikas Kedigehalli
>            Assignee: Vikas Kedigehalli
>
> Datastore v1beta2 API is getting deprecated in favor of v1beta3. Hence the DatastoreIO
needs to be migrated to use the new version. Also in the process of doing so, this is a good
time to add a level of indirection via a PTranform such that future changes in Datastore API
would not result in changing user/pipeline code. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message