beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Solomon Duskis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2395) BigtableIO for Python SDK
Date Tue, 20 Jun 2017 19:01:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056286#comment-16056286
] 

Solomon Duskis commented on BEAM-2395:
--------------------------------------

The python cloud bigtable client is missing some key features that the java client has relating
to robustness and performance.  Specifically, the Java client has a "smart retries" feature
that allows writes and reads to proceed despite temporary error conditions.  The python client
also needs use the "bulk write" API for performance purposes. 

Without those features, a python Cloud Bigtable connector should not be considered ready for
production.  FWIW, there are ongoing efforts to add those features.

> BigtableIO for Python SDK
> -------------------------
>
>                 Key: BEAM-2395
>                 URL: https://issues.apache.org/jira/browse/BEAM-2395
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py
>            Reporter: Matthias Baetens
>            Assignee: Matthias Baetens
>              Labels: features
>
> Developing a read and write IO for BigTable for the Python SDK. 
> Working / design document can be found here: https://docs.google.com/document/d/1iXeQvIAsGjp9orleDy0o5ExU-eMqWesgvtt231UoaPg/edit?usp=sharing



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message