hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajesh Balamohan <rajesh.balamo...@gmail.com>
Subject o.a.h.m.MapTask: data buffer - Takes long time to come out
Date Fri, 01 Feb 2013 01:01:03 GMT
Hi Experts,

At times, we have seen tasks taking a lot long time map tasks and looking
at the task logs, its spending a lot of time in "o.a.h.m.MapTask: data
buffer = xxx / yyy".

After sometime it prints the next line " MapTask: record buffer = xxx /
yyy". I initially thought it was allocating data buffer in JVM and causing
memory pressure. But it doesn't seem to be the case and no swapping is
happening in the system as well.

Has anyone else faced similar issue with MR-1.0? Any pointers would be
appreciated.

-- 
~Rajesh.B

Mime
View raw message