hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From nagarjuna kanamarlapudi <nagarjuna.kanamarlap...@gmail.com>
Subject Fwd: Understanding MapReduce source code : Flush operations
Date Mon, 06 Jan 2014 14:35:23 GMT
---------- Forwarded message ----------
From: nagarjuna kanamarlapudi <nagarjuna.kanamarlapudi@gmail.com>
Date: Mon, Jan 6, 2014 at 6:39 PM
Subject: Understanding MapReduce source code : Flush operations
To: mapreduce-user@hadoop.apache.org


I am using hadoop/ map reduce for aout 2.5 years. I want to understand the
internals of the hadoop source code.

Let me put my requirement very clear.

I want to have a look at the code where of flush operations that happens
after the reduce phase.

Reducer writes the output to OutputFormat which inturn pushes that to
memory and once it reaches 90% of chunk size it starts to flush the reducer

I essentially want to look at the code of that flushing operation.

Nagarjuna K

View raw message