hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: AlreadyExistsException for log file on 0.20.205.0
Date Tue, 27 Dec 2011 07:20:42 GMT
Is this with jvm reuse turned on?

On Dec 26, 2011, at 9:38 AM, Markus Jelsma wrote:

> Hi,
> 
> We're sometimes seeing this exception if a map task already failed before due 
> to, for example, an OOM error. Any ideas on how to address this issue?
> 
> org.apache.hadoop.io.SecureIOUtils$AlreadyExistsException: File 
> /opt/hadoop/hadoop-0.20.205.0/libexec/../logs/userlogs/job_201112261420_0003/attempt_201112261420_0003_m_000029_1/log.tmp

> already exists
> 	at 
> org.apache.hadoop.io.SecureIOUtils.insecureCreateForWrite(SecureIOUtils.java:130)
> 	at 
> org.apache.hadoop.io.SecureIOUtils.createForWrite(SecureIOUtils.java:157)
> 	at org.apache.hadoop.mapred.TaskLog.writeToIndexFile(TaskLog.java:296)
> 	at org.apache.hadoop.mapred.TaskLog.syncLogs(TaskLog.java:369)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:257)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:249)
> 
> 
> Thanks


Mime
View raw message