hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11534) Add counters for number of blocks in pending IBR
Date Thu, 23 Mar 2017 21:35:41 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939265#comment-15939265

Arpit Agarwal commented on HDFS-11534:

Thanks for the updated patch [~xiaobingo].
# We don't need DataNode#getBlocksInPendingIBR JSON since we are already publishing each individual
counter as a metric.
# generateIBRs can just set each counter to zero so we don't need the decrement function.
I should have caught this last time.

> Add counters for number of blocks in pending IBR
> ------------------------------------------------
>                 Key: HDFS-11534
>                 URL: https://issues.apache.org/jira/browse/HDFS-11534
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs
>            Reporter: Xiaobing Zhou
>            Assignee: Xiaobing Zhou
>         Attachments: HDFS-11534.000.patch, HDFS-11534.001.patch, HDFS-11534.002.patch
> IBR can be sent in batch. For the sake of diagnosis, it's helpful to understand work
load of pending queue, e.g. how many blocks as total, how many blocks in status of RECEIVING_BLOCK,
RECEIVED_BLOCK, and DELETED_BLOCK, respectively. Also the metrics can be exposed to JMX.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message