hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koert Kuipers <ko...@tresata.com>
Subject question about mapred.local.dir for hadoop 1.x
Date Thu, 14 Mar 2013 21:26:45 GMT
if i specify multiple directories on separate disks in mapred.local.dir,
will a task write to one of them, or to all of them?

and if one of those disks becomes full, will the task be smart enough to
start writing to another directory that is on a disk that is not full?

and really the same question asked slighly differently: when i see a task
failing because there was no more space, could this be because one of those
directories was on a full disk despite the fact that there was plenty of
space in other directories in mapred.local.dir?

thanks! koert

View raw message