Return-Path: X-Original-To: apmail-tez-commits-archive@minotaur.apache.org Delivered-To: apmail-tez-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 642EC18F17 for ; Wed, 24 Jun 2015 09:35:14 +0000 (UTC) Received: (qmail 18176 invoked by uid 500); 24 Jun 2015 09:35:14 -0000 Delivered-To: apmail-tez-commits-archive@tez.apache.org Received: (qmail 18140 invoked by uid 500); 24 Jun 2015 09:35:14 -0000 Mailing-List: contact commits-help@tez.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tez.apache.org Delivered-To: mailing list commits@tez.apache.org Received: (qmail 18131 invoked by uid 99); 24 Jun 2015 09:35:14 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Jun 2015 09:35:14 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id DCF87E032D; Wed, 24 Jun 2015 09:35:13 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: rbalamohan@apache.org To: commits@tez.apache.org Message-Id: <7f5f31a3297942fc9b30eafcc7669d31@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: tez git commit: TEZ-2378. In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size (rbalamohan) Date: Wed, 24 Jun 2015 09:35:13 +0000 (UTC) Repository: tez Updated Branches: refs/heads/master d48d9f04d -> 173823819 TEZ-2378. In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size (rbalamohan) Project: http://git-wip-us.apache.org/repos/asf/tez/repo Commit: http://git-wip-us.apache.org/repos/asf/tez/commit/17382381 Tree: http://git-wip-us.apache.org/repos/asf/tez/tree/17382381 Diff: http://git-wip-us.apache.org/repos/asf/tez/diff/17382381 Branch: refs/heads/master Commit: 17382381965694d9562e5a5f96fdc1a2bf61874a Parents: d48d9f0 Author: Rajesh Balamohan Authored: Wed Jun 24 15:07:07 2015 +0530 Committer: Rajesh Balamohan Committed: Wed Jun 24 15:07:07 2015 +0530 ---------------------------------------------------------------------- CHANGES.txt | 1 + .../apache/tez/runtime/library/common/shuffle/Fetcher.java | 7 +++++-- 2 files changed, 6 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/tez/blob/17382381/CHANGES.txt ---------------------------------------------------------------------- diff --git a/CHANGES.txt b/CHANGES.txt index f989d7e..d2f0de1 100644 --- a/CHANGES.txt +++ b/CHANGES.txt @@ -9,6 +9,7 @@ INCOMPATIBLE CHANGES TEZ-2468. Change the minimum Java version to Java 7. ALL CHANGES: + TEZ-2378. In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size. TEZ-1314. Port MAPREDUCE-5821 to Tez. TEZ-2558. Upload additional Tez images. TEZ-2486. Update tez website to include links based on http://git-wip-us.apache.org/repos/asf/tez/blob/17382381/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java ---------------------------------------------------------------------- diff --git a/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java b/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java index e7c98b7..04cf5b5 100644 --- a/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java +++ b/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java @@ -577,8 +577,11 @@ public class Fetcher extends CallableWithNdc { host + " : " + e.getClass().getName() + ", message=" + e.getMessage()); break; } - LOG.warn("Failed to shuffle output of " + srcAttemptId + " from " + host + "(local fetch)", - e); + if (failMissing) { + LOG.warn( + "Failed to shuffle output of " + srcAttemptId + " from " + host + "(local fetch)", + e); + } } }