Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B9C37200D01 for ; Fri, 8 Sep 2017 04:35:03 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B824016127B; Fri, 8 Sep 2017 02:35:03 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0B6E51609BE for ; Fri, 8 Sep 2017 04:35:02 +0200 (CEST) Received: (qmail 98784 invoked by uid 500); 8 Sep 2017 02:35:02 -0000 Mailing-List: contact commits-help@gobblin.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@gobblin.incubator.apache.org Delivered-To: mailing list commits@gobblin.incubator.apache.org Received: (qmail 98764 invoked by uid 99); 8 Sep 2017 02:35:02 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Sep 2017 02:35:02 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 02DB2F56BA; Fri, 8 Sep 2017 02:35:01 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: abti@apache.org To: commits@gobblin.apache.org Date: Fri, 08 Sep 2017 02:35:01 -0000 Message-Id: <1f6812652159400480e40c70d49c2898@git.apache.org> In-Reply-To: <15e4e84cfe1f4fd4ada9989eeedc17ce@git.apache.org> References: <15e4e84cfe1f4fd4ada9989eeedc17ce@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [2/2] incubator-gobblin git commit: Merge pull request #1993 from treff7es/eventual_consistent_fs_support archived-at: Fri, 08 Sep 2017 02:35:03 -0000 Merge pull request #1993 from treff7es/eventual_consistent_fs_support Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/commit/344d6d3c Tree: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/tree/344d6d3c Diff: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/diff/344d6d3c Branch: refs/heads/master Commit: 344d6d3c68b23ba451cabbf3bacb389e38e27f11 Parents: 6b616d4 0e87095 Author: Abhishek Tiwari Authored: Thu Sep 7 19:34:48 2017 -0700 Committer: Abhishek Tiwari Committed: Thu Sep 7 19:34:48 2017 -0700 ---------------------------------------------------------------------- .../gobblin/util/RecordCountProvider.java | 2 +- .../compaction/mapreduce/MRCompactor.java | 4 + .../mapreduce/MRCompactorJobRunner.java | 112 +++++++++++++++--- .../gobblin/writer/AsyncWriterManager.java | 4 +- .../writer/exception/NonTransientException.java | 40 ------- gobblin-core/build.gradle | 1 - .../gobblin/publisher/BaseDataPublisher.java | 60 ++++++++-- .../publisher/TimePartitionedDataPublisher.java | 4 +- .../publisher/TimestampDataPublisher.java | 8 +- .../apache/gobblin/retry/RetryerFactory.java | 116 ------------------- .../org/apache/gobblin/writer/RetryWriter.java | 2 +- .../writer/http/SalesforceRestWriter.java | 7 +- .../apache/gobblin/writer/RetryWriterTest.java | 10 +- .../GoogleAnalyticsUnsampledExtractor.java | 15 +-- .../GoogleAnalyticsUnsampledExtractorTest.java | 12 +- gobblin-utility/build.gradle | 1 + .../exception/NonTransientException.java | 40 +++++++ .../org/apache/gobblin/util/WriterUtils.java | 35 +++++- .../CompactionRecordCountProvider.java | 18 ++- .../gobblin/util/retry/RetryerFactory.java | 116 +++++++++++++++++++ 20 files changed, 384 insertions(+), 223 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-gobblin/blob/344d6d3c/gobblin-core-base/src/main/java/org/apache/gobblin/writer/AsyncWriterManager.java ----------------------------------------------------------------------