hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koert Kuipers <ko...@tresata.com>
Subject where does the temporary task directory get created in mapred?
Date Sat, 27 Sep 2014 18:28:51 GMT
i was looking at
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter's setupTask
method, but it does nothing and states:

    // FileOutputCommitter's setupTask doesn't do anything. Because the
    // temporary task directory is created on demand when the
    // task is writing.

ok i got that. but then where is the temporary task then created "on demand
when the task is writing"? i looked all over the OutputCommitters,
RecordWriters, OutputFormats, but i cannot find it. i must have overlooked

can someone please point me to the relevant class/method? thank you so much!

best, koert

View raw message