hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-4135) Add method to DFSOutputStream to dump pipeline status
Date Thu, 01 Nov 2012 17:07:13 GMT
Todd Lipcon created HDFS-4135:

             Summary: Add method to DFSOutputStream to dump pipeline status
                 Key: HDFS-4135
                 URL: https://issues.apache.org/jira/browse/HDFS-4135
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: hdfs client
    Affects Versions: 2.0.2-alpha, 3.0.0
            Reporter: Todd Lipcon

Occasionally higher-level apps (like HBase) will detect that an outputstream is acting slower
than usual. It would be nice to be able to log a WARN message which contains the current state
of the pipeline, so that its easier for operators to diagnose why things might be acting up.
I would like to see:
- block ID
- number of acked bytes, number of bytes written to pipeline
- current state of ack queue (how many packets are un-acked)
- datanode IDs of pipeline
- any latency information we could easily collect

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message