hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Foley (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-1729) Improve metrics for measuring NN startup costs.
Date Thu, 21 Apr 2011 00:22:05 GMT

     [ https://issues.apache.org/jira/browse/HDFS-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Matt Foley resolved HDFS-1729.

    Resolution: Invalid


> Improve metrics for measuring NN startup costs.
> -----------------------------------------------
>                 Key: HDFS-1729
>                 URL: https://issues.apache.org/jira/browse/HDFS-1729
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: name-node
>            Reporter: Owen O'Malley
>            Assignee: Matt Foley
>             Fix For:
> Current logging and metrics are insufficient to diagnose latency problems in cluster
startup.  Add:
> 1. better logs in both Datanode and Namenode for Initial Block Report processing, to
help distinguish between block
> report processing problems and RPC/queuing problems;
> 2. new logs to measure cost of scanning all blocks for over/under/invalid replicas, which
occurs in Namenode just
> before exiting safe mode;
> 3. new logs to measure cost of processing the under/invalid replica queues (created by
the above mentioned scan), which
> occurs just after exiting safe mode, and is said to take 100% of CPU.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message