hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ch huang <justlo...@gmail.com>
Subject is mapreduce.task.io.sort.mb control both map merge buffer and reduce merge buffer?
Date Thu, 12 Dec 2013 01:52:18 GMT
hi,maillist:
              Due to the heavy job on reduce task, i try to increase buffer
size for sort merge,i wander if i increase mapreduce.task.io.sort.mb from
100m(default value) to 1G will cause each map task  sort merge buffer also
become 1G?

Mime
View raw message