Return-Path: X-Original-To: apmail-beam-commits-archive@minotaur.apache.org Delivered-To: apmail-beam-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 12B0518F97 for ; Fri, 18 Mar 2016 17:29:36 +0000 (UTC) Received: (qmail 36405 invoked by uid 500); 18 Mar 2016 17:29:36 -0000 Delivered-To: apmail-beam-commits-archive@beam.apache.org Received: (qmail 36355 invoked by uid 500); 18 Mar 2016 17:29:36 -0000 Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.incubator.apache.org Delivered-To: mailing list commits@beam.incubator.apache.org Received: (qmail 36319 invoked by uid 99); 18 Mar 2016 17:29:36 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Mar 2016 17:29:36 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 642FF1804A1 for ; Fri, 18 Mar 2016 17:29:36 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.021 X-Spam-Level: X-Spam-Status: No, score=-4.021 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id KrylAn7mUqBi for ; Fri, 18 Mar 2016 17:29:35 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id AED455F23C for ; Fri, 18 Mar 2016 17:29:34 +0000 (UTC) Received: (qmail 35194 invoked by uid 99); 18 Mar 2016 17:29:33 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Mar 2016 17:29:33 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id B937F2C1F6B for ; Fri, 18 Mar 2016 17:29:33 +0000 (UTC) Date: Fri, 18 Mar 2016 17:29:33 +0000 (UTC) From: "Mark Shields (JIRA)" To: commits@beam.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (BEAM-129) Support pubsub IO MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/BEAM-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201816#comment-15201816 ] Mark Shields commented on BEAM-129: ----------------------------------- For the read side I think this boils down to https://issues.apache.org/jira/browse/BEAM-125 plus making sure the Flink runner is invoking UnboundedSource readers appropriately. I'm working on BEAM-125 right now. (Turns out to be very easy to get working, but more challenging to make fast.) For the write side ideally we'll start with generic UnboundedSink, then implement pub/sub writes on that, then the Flink runner would invoke that generically. A shorter-term solution may be in order. > Support pubsub IO > ----------------- > > Key: BEAM-129 > URL: https://issues.apache.org/jira/browse/BEAM-129 > Project: Beam > Issue Type: New Feature > Components: runner-flink > Reporter: Kostas Kloudas > Assignee: Maximilian Michels > > Support pubsub IO -- This message was sent by Atlassian JIRA (v6.3.4#6332)