hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Markus Jelsma <markus.jel...@openindex.io>
Subject AlreadyExistsException for log file on 0.20.205.0
Date Mon, 26 Dec 2011 17:38:24 GMT
Hi,

We're sometimes seeing this exception if a map task already failed before due 
to, for example, an OOM error. Any ideas on how to address this issue?

org.apache.hadoop.io.SecureIOUtils$AlreadyExistsException: File 
/opt/hadoop/hadoop-0.20.205.0/libexec/../logs/userlogs/job_201112261420_0003/attempt_201112261420_0003_m_000029_1/log.tmp

already exists
	at 
org.apache.hadoop.io.SecureIOUtils.insecureCreateForWrite(SecureIOUtils.java:130)
	at 
org.apache.hadoop.io.SecureIOUtils.createForWrite(SecureIOUtils.java:157)
	at org.apache.hadoop.mapred.TaskLog.writeToIndexFile(TaskLog.java:296)
	at org.apache.hadoop.mapred.TaskLog.syncLogs(TaskLog.java:369)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:257)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)


Thanks

Mime
View raw message