hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ioannis Koltsidas (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-3585) Hardware Failure Monitoring in large clusters running Hadoop/HDFS
Date Tue, 17 Jun 2008 21:00:45 GMT
Hardware Failure Monitoring in large clusters running Hadoop/HDFS

                 Key: HADOOP-3585
                 URL: https://issues.apache.org/jira/browse/HADOOP-3585
             Project: Hadoop Core
          Issue Type: New Feature
         Environment: Linux
            Reporter: Ioannis Koltsidas
            Priority: Minor

At IBM we're interested in identifying hardware failures on large clusters running Hadoop/HDFS.
We are working on a framework that will enable nodes to identify failures on their hardware
using the Hadoop log, the system log and various OS hardware diagnosing utilities. The implementation
details are not very clear, but you can see a draft of our design in the attached document.
We are pretty interested in Hadoop and system logs from failed machines, so if you are in
possession of such, you are very welcome to contribute them; they would be of great value
for hardware failure diagnosing.

Some details about our design can be found in the attached document failmon.doc. More details
will follow in a later post.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message