tez-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jeag...@apache.org
Subject tez git commit: TEZ-3981. UnorderedPartitionedKVWriter.getInitialMemoryRequirement may return negative memory (Jaume M via jeagles)
Date Mon, 24 Sep 2018 23:16:41 GMT
Repository: tez
Updated Branches:
  refs/heads/branch-0.10.0 d1e0c78d6 -> f74475f96


TEZ-3981. UnorderedPartitionedKVWriter.getInitialMemoryRequirement may return negative memory
(Jaume M via jeagles)

(cherry picked from commit 22e2a21791295716e8891134f52b076bfbff1f8f)


Project: http://git-wip-us.apache.org/repos/asf/tez/repo
Commit: http://git-wip-us.apache.org/repos/asf/tez/commit/f74475f9
Tree: http://git-wip-us.apache.org/repos/asf/tez/tree/f74475f9
Diff: http://git-wip-us.apache.org/repos/asf/tez/diff/f74475f9

Branch: refs/heads/branch-0.10.0
Commit: f74475f96ca2ecef2e2f3978b1b2391a8d1f785d
Parents: d1e0c78
Author: Jaume M <jmarhuenda@hortonworks.com>
Authored: Mon Sep 24 16:13:24 2018 -0700
Committer: Jonathan Eagles <jeagles@yahoo-inc.com>
Committed: Mon Sep 24 16:14:33 2018 -0700

----------------------------------------------------------------------
 .../library/common/writers/UnorderedPartitionedKVWriter.java       | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/tez/blob/f74475f9/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/writers/UnorderedPartitionedKVWriter.java
----------------------------------------------------------------------
diff --git a/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/writers/UnorderedPartitionedKVWriter.java
b/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/writers/UnorderedPartitionedKVWriter.java
index 948417d..0486ddc 100644
--- a/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/writers/UnorderedPartitionedKVWriter.java
+++ b/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/writers/UnorderedPartitionedKVWriter.java
@@ -670,7 +670,7 @@ public class UnorderedPartitionedKVWriter extends BaseUnorderedPartitionedKVWrit
   }
 
   public static long getInitialMemoryRequirement(Configuration conf, long maxAvailableTaskMemory)
{
-    int initialMemRequestMb = conf.getInt(
+    long initialMemRequestMb = conf.getInt(
         TezRuntimeConfiguration.TEZ_RUNTIME_UNORDERED_OUTPUT_BUFFER_SIZE_MB,
         TezRuntimeConfiguration.TEZ_RUNTIME_UNORDERED_OUTPUT_BUFFER_SIZE_MB_DEFAULT);
     Preconditions.checkArgument(initialMemRequestMb != 0,


Mime
View raw message