hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "#YONG YONG CHENG#" <aarnc...@pmail.ntu.edu.sg>
Subject Close() method in Map Task
Date Wed, 20 Jan 2010 05:15:22 GMT
Good Day,
 
I am using Hadoop 0.19.1 on a Windows cluster. Everything work fine.
But I have a programming question.
 
For a successful map task, close() method will be invoked by the map task.
But for a failed and killed map task, close() method is not invoked.
 
I get the above finding by putting a println statement in the close() method of the
map task.
 
My question is, how to clean up the resource used by the map task if it fails or being killed?
 
Thanks,

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message