hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yanbo Liang <yanboha...@gmail.com>
Subject Re: Why hadoop is spawing two map over file size 1.5 KB ?
Date Thu, 14 Mar 2013 15:11:54 GMT
I guess may be one of them is the speculative execution.
You can check the parameter "mapred.map.tasks.speculative.execution" to
ensure whether it is allowed speculative execution.
You can get the precise information that whether it is speculative map task
from the tasktracker log.

2013/3/12 samir das mohapatra <samir.helpdoc@gmail.com>

> Hi All,
>   I have very fundamental doubt, I have file having size 1.5KB and block
> size is default block size, But i could see two mapper it got creted during
> the Job. Could you please help  to get whole picture why it is .
> Regards,
> samir.

View raw message