Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@beam.incubator.apache.org
Date: Fri, 20 May 2016 20:05:12 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: commits@beam.incubator.apache.org
Message-ID: <JIRA.12944521.1456414503000.252870.1463774712911@Atlassian.JIRA>
In-Reply-To: <JIRA.12944521.1456414503000@Atlassian.JIRA>
References: <JIRA.12944521.1456414503000@Atlassian.JIRA> <JIRA.12944521.1456414503728@arcas>
Subject: [jira] [Commented] (BEAM-53) PubSubIO: reimplement in Java
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Fri, 20 May 2016 20:05:18 -0000


    [ https://issues.apache.org/jira/browse/BEAM-53?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15294084#comment-15294084 ] 

ASF GitHub Bot commented on BEAM-53:
------------------------------------

GitHub user dhalperi opened a pull request:

    https://github.com/apache/incubator-beam/pull/367

    [BEAM-53] PubSub: build fixups

    * Always RunWith on a unit test
    * Mockito bugfix for Java 9

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/dhalperi/incubator-beam build-fixups

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/367.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #367
    
----
commit 30c3c3b5f6c95c9d9a6febde391558023ccf73bd
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-05-20T20:04:12Z

    PubSub: build fixups
    
    * Always RunWith on a unit test
    * Mockito bugfix for Java 9

----


> PubSubIO: reimplement in Java
> -----------------------------
>
>                 Key: BEAM-53
>                 URL: https://issues.apache.org/jira/browse/BEAM-53
>             Project: Beam
>          Issue Type: New Feature
>          Components: runner-core
>            Reporter: Daniel Halperin
>            Assignee: Mark Shields
>
> PubSubIO is currently only partially implemented in Java: the DirectPipelineRunner uses a non-scalable API in a single-threaded manner.
> In contrast, the DataflowPipelineRunner uses an entirely different code path implemented in the Google Cloud Dataflow service.
> We need to reimplement PubSubIO in Java in order to support other runners in a scalable way.
> Additionally, we can take this opportunity to add new features:
> * getting timestamp from an arbitrary lambda in arbitrary formats rather than from a message attribute in only 2 formats.
> * exposing metadata and attributes in the elements produced by PubSubIO.Read
> * setting metadata and attributes in the messages written by PubSubIO.Write


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)