hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haohui Mai (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-7331) Add Datanode network counts to datanode jmx page
Date Thu, 20 Nov 2014 23:59:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220235#comment-14220235
] 

Haohui Mai edited comment on HDFS-7331 at 11/20/14 11:58 PM:
-------------------------------------------------------------

bq. ... somewhat handled by external cluster management tools, since they periodically sample
and can do the subtraction to see the change over time.

I know most of the metric systems will collect metrics and plot graphs directly. I'm unaware
of any metrics systems that can do subtraction out-of-the-box. Some pointers are appreciated.

This metric is quite useful, personally I think some sorts of TTL is required so that the
metric can be consumed and integrated with existing metric systems. Does it make sense to
you guys?



was (Author: wheat9):
bq. ... somewhat handled by external cluster management tools, since they periodically sample
and can do the subtraction to see the change over time.

I know most of the metric systems will collect metrics and plot graphs directly. I'm unaware
of any metrics systems that can do subtraction out-of-the-box. Some pointers are appreciated.

This metric is quite useful, personally I think some sorts of TTL is required so that the
metric can be consumed and integrated with existing metric systems.


> Add Datanode network counts to datanode jmx page
> ------------------------------------------------
>
>                 Key: HDFS-7331
>                 URL: https://issues.apache.org/jira/browse/HDFS-7331
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Charles Lamb
>            Assignee: Charles Lamb
>            Priority: Minor
>         Attachments: HDFS-7331.001.patch, HDFS-7331.002.patch, HDFS-7331.003.patch, HDFS-7331.004.patch
>
>
> Add per-datanode counts to the datanode jmx page. For example, networkErrors could be
exposed like this:
> {noformat}
>   }, {
> ...
>     "DatanodeNetworkCounts" : "{\"dn1\":{\"networkErrors\":1}}",
> ...
>     "NamenodeAddresses" : "{\"localhost\":\"BP-1103235125-127.0.0.1-1415057084497\"}",
>     "VolumeInfo" : "{\"/tmp/hadoop-cwl/dfs/data/current\":{\"freeSpace\":3092725760,\"usedSpace\":28672,\"reservedSpace\":0}}",
>     "ClusterId" : "CID-4b38f2ae-5e58-4e15-b3cf-3ba3f46e724e"
>   }, {
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message