hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christian Kunz (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-4654) remove temporary output directory of failed tasks
Date Thu, 13 Nov 2008 20:12:46 GMT
remove temporary output directory of failed tasks

                 Key: HADOOP-4654
                 URL: https://issues.apache.org/jira/browse/HADOOP-4654
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.18.1, 0.17.2
            Reporter: Christian Kunz

When dfs is getting full (80+% of reserved space), the rate of write failures increases, such
that more map-reduce tasks can fail. By not cleaning up the temporary output directory of
tasks the situation worsens over the lifetime of a job, increasing the probability of the
whole job failing.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message