Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9C261200BC4 for ; Sat, 5 Nov 2016 00:49:33 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 9AC3F160B11; Fri, 4 Nov 2016 23:49:33 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 94E35160B04 for ; Sat, 5 Nov 2016 00:49:31 +0100 (CET) Received: (qmail 91630 invoked by uid 500); 4 Nov 2016 23:49:30 -0000 Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.incubator.apache.org Delivered-To: mailing list commits@beam.incubator.apache.org Received: (qmail 91621 invoked by uid 99); 4 Nov 2016 23:49:30 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Nov 2016 23:49:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 45E2A1A949E for ; Fri, 4 Nov 2016 23:49:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -5.019 X-Spam-Level: X-Spam-Status: No, score=-5.019 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, KAM_MANYCOMMENTS=1.2, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id jiWkqXyW0-hG for ; Fri, 4 Nov 2016 23:49:18 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 0E3305FCAA for ; Fri, 4 Nov 2016 23:49:14 +0000 (UTC) Received: (qmail 86877 invoked by uid 99); 4 Nov 2016 23:46:44 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Nov 2016 23:46:44 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 73E1BE0C0A; Fri, 4 Nov 2016 23:46:44 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: davor@apache.org To: commits@beam.incubator.apache.org Date: Fri, 04 Nov 2016 23:46:51 -0000 Message-Id: <6ec3f8d80a08401883d6c97b11fd5450@git.apache.org> In-Reply-To: References: X-Mailer: ASF-Git Admin Mailer Subject: [08/51] [abbrv] [partial] incubator-beam-site git commit: Regenerate site archived-at: Fri, 04 Nov 2016 23:49:33 -0000 http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/61ba656f/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/InProcessTimerInternals.html ---------------------------------------------------------------------- diff --git a/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/InProcessTimerInternals.html b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/InProcessTimerInternals.html new file mode 100644 index 0000000..bb54a04 --- /dev/null +++ b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/InProcessTimerInternals.html @@ -0,0 +1,467 @@ + + + + + + +InProcessTimerInternals (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ + +
+
org.apache.beam.runners.direct
+

Class InProcessTimerInternals

+
+
+
    +
  • java.lang.Object
    • +
  • +
      +
    • org.apache.beam.runners.direct.InProcessTimerInternals
      • +
    +
    • +
+
+ +
+
+ +
+
+
    +
  • + +
      +
    • + + +

      Method Detail

      + + + + + + + +
        +
      • +

        setTimer

        +
        public void setTimer(TimerInternals.TimerData timerKey)
        +
        Description copied from interface: TimerInternals
        +
        Writes out a timer to be fired when the watermark reaches the given + timestamp. + +

        The combination of namespace, timestamp and domain uniquely + identify a timer. Multiple timers set for the same parameters can be safely deduplicated.

        +
        +
        Specified by:
        +
        setTimer in interface TimerInternals
        +
        +
        • +
      + + + + + + + + + + + + + + + + + + + +
        +
      • +

        currentInputWatermarkTime

        +
        public org.joda.time.Instant currentInputWatermarkTime()
        +
        Description copied from interface: TimerInternals
        +
        Return the current, local input watermark timestamp for this computation + in the TimeDomain.EVENT_TIME time domain. + +

        This value: +

          +
        1. Is never null, but may be BoundedWindow.TIMESTAMP_MIN_VALUE. +
        2. Is monotonically increasing. +
        3. May differ between workers due to network and other delays. +
        4. Will never be ahead of the global input watermark for this computation. But it + may be arbitrarily behind the global input watermark. +
        5. Any element with a timestamp before the local input watermark can be considered + 'locally late' and be subject to special processing or be dropped entirely. +
        + +

        Note that because the local input watermark can be behind the global input watermark, + it is possible for an element to be considered locally on-time even though it is + globally late.

        +
        +
        Specified by:
        +
        currentInputWatermarkTime in interface TimerInternals
        +
        +
        • +
      + + + +
        +
      • +

        currentOutputWatermarkTime

        +
        @Nullable
+public org.joda.time.Instant currentOutputWatermarkTime()
        +
        Description copied from interface: TimerInternals
        +
        Return the current, local output watermark timestamp for this computation + in the TimeDomain.EVENT_TIME time domain. Return null if unknown. + +

        This value: +

          +
        1. Is monotonically increasing. +
        2. Will never be ahead of TimerInternals.currentInputWatermarkTime() as returned above. +
        3. May differ between workers due to network and other delays. +
        4. However will never be behind the global input watermark for any following computation. +
        + +

        In pictures: + 

        +  |              |       |       |       |
+  |              |   D   |   C   |   B   |   A
+  |              |       |       |       |
+ GIWM     <=    GOWM <= LOWM <= LIWM <= GIWM
+ (next stage)
+ -------------------------------------------------> event time
+
        + where +
          +
        • LOWM = local output water mark. +
        • GOWM = global output water mark. +
        • GIWM = global input water mark. +
        • LIWM = local input water mark. +
        • A = A globally on-time element. +
        • B = A globally late, but locally on-time element. +
        • C = A locally late element which may still contribute to the timestamp of a pane. +
        • D = A locally late element which cannot contribute to the timestamp of a pane. +
        + +

        Note that if a computation emits an element which is not before the current output watermark + then that element will always appear locally on-time in all following computations. However, + it is possible for an element emitted before the current output watermark to appear locally + on-time in a following computation. Thus we must be careful to never assume locally late data + viewed on the output of a computation remains locally late on the input of a following + computation.

        +
        +
        Specified by:
        +
        currentOutputWatermarkTime in interface TimerInternals
        +
        +
        • +
      +
      • +
    +
    • +
+
+
+ + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/61ba656f/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/InProcessTransformResult.html ---------------------------------------------------------------------- diff --git a/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/InProcessTransformResult.html b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/InProcessTransformResult.html new file mode 100644 index 0000000..4d41674 --- /dev/null +++ b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/InProcessTransformResult.html @@ -0,0 +1,343 @@ + + + + + + +InProcessTransformResult (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ + +
+
org.apache.beam.runners.direct
+

Interface InProcessTransformResult

+
+
+
+ +
+
+ +
+
+ +
+
+ + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/61ba656f/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/ModelEnforcement.html ---------------------------------------------------------------------- diff --git a/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/ModelEnforcement.html b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/ModelEnforcement.html new file mode 100644 index 0000000..7f518e2 --- /dev/null +++ b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/ModelEnforcement.html @@ -0,0 +1,283 @@ + + + + + + +ModelEnforcement (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ + +
+
org.apache.beam.runners.direct
+

Interface ModelEnforcement<T>

+
+
+
+
    +
  • +
    +
    +
    public interface ModelEnforcement<T>
    +
    Enforcement tools that verify that executing code conforms to the model. + +

    ModelEnforcement is performed on a per-element and per-bundle basis. The + ModelEnforcement is provided with the input bundle as part of + ModelEnforcementFactory#forBundle(CommittedBundle, AppliedPTransform), each element + before and after that element is provided to an underlying TransformEvaluator, and the + output InProcessTransformResult and committed output bundles after the + TransformEvaluator has completed. + +

    Typically, ModelEnforcement will obtain required metadata (such as the Coder + of the input PCollection on construction, and then enforce per-element behavior + (such as the immutability of input elements). When the element is output or the bundle is + completed, the required conditions can be enforced across all elements.

    +
    • +
+
+
+ +
+
+ +
+
+ + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/61ba656f/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/ModelEnforcementFactory.html ---------------------------------------------------------------------- diff --git a/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/ModelEnforcementFactory.html b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/ModelEnforcementFactory.html new file mode 100644 index 0000000..d118ea3 --- /dev/null +++ b/content/documentation/sdks/javadoc/0.1.0-incubating/org/apache/beam/runners/direct/ModelEnforcementFactory.html @@ -0,0 +1,228 @@ + + + + + + +ModelEnforcementFactory (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ + +
+
org.apache.beam.runners.direct
+

Interface ModelEnforcementFactory

+
+
+
+ +
+
+ +
+
+ +
+
+ + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ +