Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 70B692004CA for ; Wed, 11 May 2016 18:39:26 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 6F7D7160A18; Wed, 11 May 2016 16:39:26 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id BDC6F160A09 for ; Wed, 11 May 2016 18:39:25 +0200 (CEST) Received: (qmail 67184 invoked by uid 500); 11 May 2016 16:39:24 -0000 Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.incubator.apache.org Delivered-To: mailing list commits@beam.incubator.apache.org Received: (qmail 67174 invoked by uid 99); 11 May 2016 16:39:24 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 May 2016 16:39:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 3E1FCC1B32 for ; Wed, 11 May 2016 16:39:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -5.186 X-Spam-Level: X-Spam-Status: No, score=-5.186 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, KAM_LOTSOFHASH=0.25, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-1.416] autolearn=disabled Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id UDXmFN_LzyPW for ; Wed, 11 May 2016 16:39:21 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with SMTP id 75CDE5F4ED for ; Wed, 11 May 2016 16:39:21 +0000 (UTC) Received: (qmail 65481 invoked by uid 99); 11 May 2016 16:39:15 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 May 2016 16:39:15 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 637C72C0451 for ; Wed, 11 May 2016 16:39:15 +0000 (UTC) Date: Wed, 11 May 2016 16:39:15 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: commits@beam.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (BEAM-117) Implement the API for Static Display Metadata MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 11 May 2016 16:39:26 -0000 [ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280395#comment-15280395 ] ASF GitHub Bot commented on BEAM-117: ------------------------------------- GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/325 [BEAM-117] Validate display data registration in Dataflow Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- The DataflowRunner (like other runners) transforms pipelines during construction and sends only primitive transforms to its service. This PR validates that primitive transforms are correctly registering display data for IO transforms. You can merge this pull request into a Git repository by running: $ git pull https://github.com/swegner/incubator-beam displaydata-dataflow Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/325.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #325 ---- commit c03af9e254497c9af9674b2b9517fe0b1db5381b Author: Scott Wegner Date: 2016-05-09T20:31:39Z Add overload for DisplayDataMatchers.hasDisplayItem commit 48b30e8e133a1949693fa854883471ca623e05a4 Author: Scott Wegner Date: 2016-05-09T20:50:01Z Correct DisplayDataEvaluator behavior for primitives Previously DisplayDataEvaluator would assume the input PTransform was a composite and if so collect DisplayData for inner primitives. However it incorrectly discarding DisplayData when the input itself is a primitive. This fixes the tracking logic. commit be44a9bdd81e054e7e235eae613b8c35b9f9738b Author: Scott Wegner Date: 2016-05-09T20:52:49Z Implement TransformTreeNode.toString Previously TransformTreeNode took the default Object#toString implementation, which displays the class name and ID number. This change instead uses the fullName property, which is the path of inner tranform within the graph. This is very useful for stepping through graph transformation logic in a debugger. The toString implelementation is not necessary for correctness. commit b5b7c9baeebb27cdc5f7ed5074f1d764299837b2 Author: Scott Wegner Date: 2016-05-09T20:55:07Z Add pinning test to verify BigQueryIO display data commit de888f9b353d6addc86662cd010089dc869a9854 Author: Scott Wegner Date: 2016-05-09T21:06:24Z Add pinning test for DatastoreIO display data commit dd26b46867755612aff4a74b7222ea7435a73966 Author: Scott Wegner Date: 2016-05-09T21:09:34Z Add pinning test for TextIO display data commit 2a3229bcafbdbdcd613fd16b511041f0e01c5700 Author: Scott Wegner Date: 2016-05-09T21:17:50Z Add pinning test for AvroIO display data commit df8b28de636454d4b580898fa8870c0929a3cf8d Author: Scott Wegner Date: 2016-05-09T21:23:38Z Add pinning test for PubsubIO display data ---- > Implement the API for Static Display Metadata > --------------------------------------------- > > Key: BEAM-117 > URL: https://issues.apache.org/jira/browse/BEAM-117 > Project: Beam > Issue Type: New Feature > Components: sdk-java-core > Reporter: Ben Chambers > Assignee: Scott Wegner > > As described in the following doc, we would like the SDK to allow associating display metadata with PTransforms. > https://docs.google.com/document/d/11enEB9JwVp6vO0uOYYTMYTGkr3TdNfELwWqoiUg5ZxM/edit?usp=sharing -- This message was sent by Atlassian JIRA (v6.3.4#6332)