Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C7B6D200B13 for ; Wed, 15 Jun 2016 16:23:13 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id C6570160A19; Wed, 15 Jun 2016 14:23:13 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id EDF51160A66 for ; Wed, 15 Jun 2016 16:23:10 +0200 (CEST) Received: (qmail 47219 invoked by uid 500); 15 Jun 2016 14:23:10 -0000 Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.incubator.apache.org Delivered-To: mailing list commits@beam.incubator.apache.org Received: (qmail 47132 invoked by uid 99); 15 Jun 2016 14:23:10 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jun 2016 14:23:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 52BFA180666 for ; Wed, 15 Jun 2016 14:23:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.446 X-Spam-Level: X-Spam-Status: No, score=-3.446 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, KAM_MANYCOMMENTS=1.2, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-1.426] autolearn=disabled Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id WGh7LqpsHjRG for ; Wed, 15 Jun 2016 14:22:45 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with SMTP id 615A75FE5E for ; Wed, 15 Jun 2016 14:22:32 +0000 (UTC) Received: (qmail 42391 invoked by uid 99); 15 Jun 2016 14:22:32 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jun 2016 14:22:32 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 33396E38AD; Wed, 15 Jun 2016 14:22:32 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: davor@apache.org To: commits@beam.incubator.apache.org Date: Wed, 15 Jun 2016 14:22:49 -0000 Message-Id: <6a5bf4e65a7f49849dc3a76712c387c5@git.apache.org> In-Reply-To: <55ff2dc97409451b8f815779a067f58e@git.apache.org> References: <55ff2dc97409451b8f815779a067f58e@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [19/52] [abbrv] [partial] incubator-beam-site git commit: Rebuild the website archived-at: Wed, 15 Jun 2016 14:23:14 -0000 http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/6fce44a2/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/RandomAccessData.html ---------------------------------------------------------------------- diff --git a/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/RandomAccessData.html b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/RandomAccessData.html new file mode 100644 index 0000000..838915a --- /dev/null +++ b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/RandomAccessData.html @@ -0,0 +1,607 @@ + + + + + + +RandomAccessData (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+ + +
+ + +
+ + +
+
org.apache.beam.runners.dataflow.util
+

Class RandomAccessData

+
+
+
    +
  • java.lang.Object
    • +
  • +
      +
    • org.apache.beam.runners.dataflow.util.RandomAccessData
      • +
    +
    • +
+
+
    +
  • +
    +
    +
    @NotThreadSafe
+public class RandomAccessData
+extends Object
    +
    An elastic-sized byte array which allows you to manipulate it as a stream, or access + it directly. This allows for a quick succession of moving bytes from an InputStream + to this wrapper to be used as an OutputStream and vice versa. This wrapper + also provides random access to bytes stored within. This wrapper allows users to finely + control the number of byte copies that occur. + + Anything stored within the in-memory buffer from offset size() is considered temporary + unused storage.
    +
    • +
+
+
+ +
+
+
    +
  • + + + +
      +
    • + + +

      Constructor Detail

      + + + +
        +
      • +

        RandomAccessData

        +
        public RandomAccessData()
        +
        Constructs a RandomAccessData with a default buffer size.
        +
        • +
      + + + +
        +
      • +

        RandomAccessData

        +
        public RandomAccessData(byte[] initialBuffer)
        +
        Constructs a RandomAccessData with the initial buffer.
        +
        • +
      + + + +
        +
      • +

        RandomAccessData

        +
        public RandomAccessData(int initialBufferSize)
        +
        Constructs a RandomAccessData with the given buffer size.
        +
        • +
      +
      • +
    + +
      +
    • + + +

      Method Detail

      + + + + + + + +
        +
      • +

        array

        +
        public byte[] array()
        +
        Returns the backing array.
        +
        • +
      + + + +
        +
      • +

        size

        +
        public int size()
        +
        Returns the number of bytes in the backing array that are valid.
        +
        • +
      + + + +
        +
      • +

        resetTo

        +
        public void resetTo(int position)
        +
        Resets the end of the stream to the specified position.
        +
        • +
      + + + +
        +
      • +

        asOutputStream

        +
        public OutputStream asOutputStream()
        +
        Returns an output stream which writes to the backing buffer from the current position. + Note that the internal buffer will grow as required to accomodate all data written.
        +
        • +
      + + + +
        +
      • +

        asInputStream

        +
        public InputStream asInputStream(int offset,
+                                 int length)
        +
        Returns an InputStream wrapper which supplies the portion of this backing byte buffer + starting at offset and up to length bytes. Note that the returned + InputStream is only a wrapper and any modifications to the underlying + RandomAccessData will be visible by the InputStream.
        +
        • +
      + + + +
        +
      • +

        writeTo

        +
        public void writeTo(OutputStream out,
+                    int offset,
+                    int length)
+             throws IOException
        +
        Writes length bytes starting at offset from the backing data store to the + specified output stream.
        +
        +
        Throws:
        +
        IOException
        +
        +
        • +
      + + + +
        +
      • +

        readFrom

        +
        public void readFrom(InputStream inStream,
+                     int offset,
+                     int length)
+              throws IOException
        +
        Reads length bytes from the specified input stream writing them into the backing + data store starting at offset. + +

        Note that the in memory stream will be grown to ensure there is enough capacity.

        +
        +
        Throws:
        +
        IOException
        +
        +
        • +
      + + + + + + + +
        +
      • +

        equals

        +
        public boolean equals(Object other)
        +
        +
        Overrides:
        +
        equals in class Object
        +
        +
        • +
      + + + +
        +
      • +

        hashCode

        +
        public int hashCode()
        +
        +
        Overrides:
        +
        hashCode in class Object
        +
        +
        • +
      + + + + +
      • +
    +
    • +
+
+
+ + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+ + +
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/6fce44a2/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/Stager.html ---------------------------------------------------------------------- diff --git a/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/Stager.html b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/Stager.html new file mode 100644 index 0000000..7ec07ec --- /dev/null +++ b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/Stager.html @@ -0,0 +1,228 @@ + + + + + + +Stager (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ + +
+
org.apache.beam.runners.dataflow.util
+

Interface Stager

+
+
+
+
    +
  • +
    +
    All Known Implementing Classes:
    +
    GcsStager
    +
    +
    +
    +
    public interface Stager
    +
    Interface for staging files needed for running a Dataflow pipeline.
    +
    • +
+
+
+ +
+
+
    +
  • + +
      +
    • + + +

      Method Detail

      + + + +
        +
      • +

        stageFiles

        +
        List<com.google.api.services.dataflow.model.DataflowPackage> stageFiles()
        +
        • +
      +
      • +
    +
    • +
+
+
+ + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/6fce44a2/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/TimeUtil.html ---------------------------------------------------------------------- diff --git a/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/TimeUtil.html b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/TimeUtil.html new file mode 100644 index 0000000..d0d96a8 --- /dev/null +++ b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/TimeUtil.html @@ -0,0 +1,315 @@ + + + + + + +TimeUtil (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ + +
+
org.apache.beam.runners.dataflow.util
+

Class TimeUtil

+
+
+ +
+
    +
  • +
    +
    +
    public final class TimeUtil
+extends Object
    +
    A helper class for converting between Dataflow API and SDK time + representations. + +

    Dataflow API times are strings of the form + YYYY-MM-dd'T'HH:mm:ss[.nnnn]'Z': that is, RFC 3339 + strings with optional fractional seconds and a 'Z' offset. + +

    Dataflow API durations are strings of the form ['-']sssss[.nnnn]'s': + that is, seconds with optional fractional seconds and a literal 's' at the end. + +

    In both formats, fractional seconds are either three digits (millisecond + resolution), six digits (microsecond resolution), or nine digits (nanosecond + resolution).

    +
    • +
+
+
+ +
+
+
    +
  • + +
      +
    • + + +

      Method Detail

      + + + +
        +
      • +

        toCloudTime

        +
        public static String toCloudTime(org.joda.time.ReadableInstant instant)
        +
        Converts a ReadableInstant into a Dateflow API time value.
        +
        • +
      + + + +
        +
      • +

        fromCloudTime

        +
        @Nullable
+public static org.joda.time.Instant fromCloudTime(String time)
        +
        Converts a time value received via the Dataflow API into the corresponding + Instant.
        +
        +
        Returns:
        +
        the parsed time, or null if a parse error occurs
        +
        +
        • +
      + + + +
        +
      • +

        toCloudDuration

        +
        public static String toCloudDuration(org.joda.time.ReadableDuration duration)
        +
        Converts a ReadableDuration into a Dataflow API duration string.
        +
        • +
      + + + +
        +
      • +

        fromCloudDuration

        +
        @Nullable
+public static org.joda.time.Duration fromCloudDuration(String duration)
        +
        Converts a Dataflow API duration string into a Duration.
        +
        +
        Returns:
        +
        the parsed duration, or null if a parse error occurs
        +
        +
        • +
      +
      • +
    +
    • +
+
+
+ + +
+ + +
Skip navigation links
+ + + + +
+
+ + + +
+ +
+
+
    +
  • Summary: 
    • +
  • Nested | 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
    +
  • Detail: 
    • +
  • Field | 
    • +
  • Constr | 
    • +
  • Method
    • +
+
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/6fce44a2/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DataflowPathValidator.html ---------------------------------------------------------------------- diff --git a/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DataflowPathValidator.html b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DataflowPathValidator.html new file mode 100644 index 0000000..769a487 --- /dev/null +++ b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DataflowPathValidator.html @@ -0,0 +1,166 @@ + + + + + + +Uses of Class org.apache.beam.runners.dataflow.util.DataflowPathValidator (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+
    +
  • Prev
    • +
  • Next
    • +
+ + +
+ +
+ + +
+ +
+

Uses of Class
org.apache.beam.runners.dataflow.util.DataflowPathValidator

+
+
+ +
+ +
+ + +
Skip navigation links
+ + + + +
+
+
    +
  • Prev
    • +
  • Next
    • +
+ + +
+ +
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/6fce44a2/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DataflowTransport.html ---------------------------------------------------------------------- diff --git a/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DataflowTransport.html b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DataflowTransport.html new file mode 100644 index 0000000..4015dea --- /dev/null +++ b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DataflowTransport.html @@ -0,0 +1,126 @@ + + + + + + +Uses of Class org.apache.beam.runners.dataflow.util.DataflowTransport (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+
    +
  • Prev
    • +
  • Next
    • +
+ + +
+ +
+ + +
+ +
+

Uses of Class
org.apache.beam.runners.dataflow.util.DataflowTransport

+
+
No usage of org.apache.beam.runners.dataflow.util.DataflowTransport
+ +
+ + +
Skip navigation links
+ + + + +
+
+
    +
  • Prev
    • +
  • Next
    • +
+ + +
+ +
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/6fce44a2/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DoFnInfo.html ---------------------------------------------------------------------- diff --git a/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DoFnInfo.html b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DoFnInfo.html new file mode 100644 index 0000000..e80edd7 --- /dev/null +++ b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/DoFnInfo.html @@ -0,0 +1,126 @@ + + + + + + +Uses of Class org.apache.beam.runners.dataflow.util.DoFnInfo (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+
    +
  • Prev
    • +
  • Next
    • +
+ + +
+ +
+ + +
+ +
+

Uses of Class
org.apache.beam.runners.dataflow.util.DoFnInfo

+
+
No usage of org.apache.beam.runners.dataflow.util.DoFnInfo
+ +
+ + +
Skip navigation links
+ + + + +
+
+
    +
  • Prev
    • +
  • Next
    • +
+ + +
+ +
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/6fce44a2/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/GcsStager.html ---------------------------------------------------------------------- diff --git a/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/GcsStager.html b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/GcsStager.html new file mode 100644 index 0000000..801d8e0 --- /dev/null +++ b/content/javadoc/0.1.0-incubating/org/apache/beam/runners/dataflow/util/class-use/GcsStager.html @@ -0,0 +1,166 @@ + + + + + + +Uses of Class org.apache.beam.runners.dataflow.util.GcsStager (Apache Beam SDK for Java 0.1.0-incubating API) + + + + + + + + +
+ + +
Skip navigation links
+ + + + +
+
+
    +
  • Prev
    • +
  • Next
    • +
+ + +
+ +
+ + +
+ +
+

Uses of Class
org.apache.beam.runners.dataflow.util.GcsStager

+
+
+ +
+ +
+ + +
Skip navigation links
+ + + + +
+
+
    +
  • Prev
    • +
  • Next
    • +
+ + +
+ +
+ + +
+ +

Copyright © 2016 The Apache Software Foundation. All rights reserved.

+ +