hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manoj Babu <manoj...@gmail.com>
Subject Re: Reg: Map output copy failure
Date Mon, 10 Dec 2012 13:29:22 GMT
In the ReduceTask.java having the below code

maxSize = (int)(conf.getInt("mapred.job.reduce.total.mem.bytes",
            (int)Math.min(Runtime.getRuntime().maxMemory(),
Integer.MAX_VALUE))
          * maxInMemCopyUse);

But in the patch
 maxSize = (long)Math.min(
             Runtime.getRuntime().maxMemory() * maxInMemCopyUse,
             Integer.MAX_VALUE);

Whether cdh3u1 not holding this fix?
Kindly Advice.

Cheers!
Manoj.



On Mon, Dec 10, 2012 at 6:39 PM, Manoj Babu <manoj444@gmail.com> wrote:

> 	at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1302)
>
>

Mime
View raw message