Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D48BC200C82 for ; Sat, 13 May 2017 00:04:02 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D303E160BCB; Fri, 12 May 2017 22:04:02 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 26272160BB8 for ; Sat, 13 May 2017 00:04:01 +0200 (CEST) Received: (qmail 97863 invoked by uid 500); 12 May 2017 22:04:01 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 97850 invoked by uid 99); 12 May 2017 22:04:01 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 May 2017 22:04:01 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 3DD23DFFB2; Fri, 12 May 2017 22:04:01 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: dhalperi@apache.org To: commits@beam.apache.org Date: Fri, 12 May 2017 22:04:02 -0000 Message-Id: <128887869b114c429ec0417d7b62d7d1@git.apache.org> In-Reply-To: References: X-Mailer: ASF-Git Admin Mailer Subject: [2/2] beam git commit: This closes #3129 archived-at: Fri, 12 May 2017 22:04:03 -0000 This closes #3129 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7b598f87 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7b598f87 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7b598f87 Branch: refs/heads/release-2.0.0 Commit: 7b598f8781211c165bf183139d673a407993c32f Parents: c807fec e6ee1d8 Author: Dan Halperin Authored: Fri May 12 15:03:54 2017 -0700 Committer: Dan Halperin Committed: Fri May 12 15:03:54 2017 -0700 ---------------------------------------------------------------------- pom.xml | 4 + .../utils/SerializablePipelineOptions.java | 2 +- runners/direct-java/pom.xml | 4 + .../utils/SerializedPipelineOptions.java | 2 +- .../DataflowPipelineTranslatorTest.java | 2 +- .../runners/dataflow/DataflowRunnerTest.java | 6 +- .../options/DataflowPipelineOptionsTest.java | 4 +- .../runners/dataflow/util/PackageUtilTest.java | 2 +- .../spark/translation/SparkRuntimeContext.java | 2 +- sdks/java/core/pom.xml | 4 + .../org/apache/beam/sdk/PipelineRunner.java | 2 +- .../beam/sdk/annotations/Experimental.java | 7 + .../java/org/apache/beam/sdk/io/AvroIO.java | 4 + .../org/apache/beam/sdk/io/FileBasedSink.java | 21 ++- .../java/org/apache/beam/sdk/io/FileSystem.java | 3 + .../apache/beam/sdk/io/FileSystemRegistrar.java | 3 + .../org/apache/beam/sdk/io/FileSystems.java | 21 ++- .../beam/sdk/io/LocalFileSystemRegistrar.java | 3 + .../org/apache/beam/sdk/io/LocalResources.java | 3 + .../java/org/apache/beam/sdk/io/TFRecordIO.java | 4 + .../java/org/apache/beam/sdk/io/TextIO.java | 4 + .../org/apache/beam/sdk/io/fs/ResourceId.java | 3 + .../apache/beam/sdk/testing/TestPipeline.java | 2 +- .../apache/beam/sdk/io/LocalResourceIdTest.java | 6 + .../apache/beam/sdk/io/fs/ResourceIdTester.java | 150 +++++++++++++++++++ .../google-cloud-platform-core/pom.xml | 6 + .../gcp/storage/GcsFileSystemRegistrar.java | 5 +- .../gcp/storage/GcsResourceIdTest.java | 9 ++ sdks/java/io/hadoop-file-system/pom.xml | 13 ++ .../beam/sdk/io/hdfs/HadoopFileSystem.java | 32 ++-- .../sdk/io/hdfs/HadoopFileSystemOptions.java | 3 + .../sdk/io/hdfs/HadoopFileSystemRegistrar.java | 3 + .../beam/sdk/io/hdfs/HadoopResourceId.java | 16 +- .../beam/sdk/io/hdfs/HadoopFileSystemTest.java | 5 +- .../beam/sdk/io/hdfs/HadoopResourceIdTest.java | 71 +++++++++ 35 files changed, 395 insertions(+), 36 deletions(-) ----------------------------------------------------------------------