tez-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rbalamo...@apache.org
Subject tez git commit: TEZ-2378. In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size (rbalamohan)
Date Wed, 24 Jun 2015 09:35:13 GMT
Repository: tez
Updated Branches:
  refs/heads/master d48d9f04d -> 173823819


TEZ-2378. In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce
log size (rbalamohan)


Project: http://git-wip-us.apache.org/repos/asf/tez/repo
Commit: http://git-wip-us.apache.org/repos/asf/tez/commit/17382381
Tree: http://git-wip-us.apache.org/repos/asf/tez/tree/17382381
Diff: http://git-wip-us.apache.org/repos/asf/tez/diff/17382381

Branch: refs/heads/master
Commit: 17382381965694d9562e5a5f96fdc1a2bf61874a
Parents: d48d9f0
Author: Rajesh Balamohan <rbalamohan@apache.org>
Authored: Wed Jun 24 15:07:07 2015 +0530
Committer: Rajesh Balamohan <rbalamohan@apache.org>
Committed: Wed Jun 24 15:07:07 2015 +0530

----------------------------------------------------------------------
 CHANGES.txt                                                   | 1 +
 .../apache/tez/runtime/library/common/shuffle/Fetcher.java    | 7 +++++--
 2 files changed, 6 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/tez/blob/17382381/CHANGES.txt
----------------------------------------------------------------------
diff --git a/CHANGES.txt b/CHANGES.txt
index f989d7e..d2f0de1 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -9,6 +9,7 @@ INCOMPATIBLE CHANGES
   TEZ-2468. Change the minimum Java version to Java 7.
 
 ALL CHANGES:
+  TEZ-2378. In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce
log size.
   TEZ-1314. Port MAPREDUCE-5821 to Tez.
   TEZ-2558. Upload additional Tez images.
   TEZ-2486. Update tez website to include links based on

http://git-wip-us.apache.org/repos/asf/tez/blob/17382381/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java
----------------------------------------------------------------------
diff --git a/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java
b/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java
index e7c98b7..04cf5b5 100644
--- a/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java
+++ b/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/Fetcher.java
@@ -577,8 +577,11 @@ public class Fetcher extends CallableWithNdc<FetchResult> {
                   host + " : " + e.getClass().getName() + ", message=" + e.getMessage());
           break;
         }
-        LOG.warn("Failed to shuffle output of " + srcAttemptId + " from " + host + "(local
fetch)",
-            e);
+        if (failMissing) {
+          LOG.warn(
+              "Failed to shuffle output of " + srcAttemptId + " from " + host + "(local fetch)",
+              e);
+        }
       }
     }
 


Mime
View raw message