hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manoj Babu <manoj...@gmail.com>
Subject Re: Reg: Map output copy failure
Date Mon, 10 Dec 2012 13:38:05 GMT
Please ignore the above comment.

Cheers!
Manoj.



On Mon, Dec 10, 2012 at 6:59 PM, Manoj Babu <manoj444@gmail.com> wrote:

> In the ReduceTask.java having the below code
>
> maxSize = (int)(conf.getInt("mapred.job.reduce.total.mem.bytes",
>             (int)Math.min(Runtime.getRuntime().maxMemory(),
> Integer.MAX_VALUE))
>           * maxInMemCopyUse);
>
> But in the patch
>  maxSize = (long)Math.min(
>              Runtime.getRuntime().maxMemory() * maxInMemCopyUse,
>              Integer.MAX_VALUE);
>
> Whether cdh3u1 not holding this fix?
> Kindly Advice.
>
> Cheers!
> Manoj.
>
>
>
> On Mon, Dec 10, 2012 at 6:39 PM, Manoj Babu <manoj444@gmail.com> wrote:
>
>> 	at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1302)
>>
>>
>

Mime
View raw message