hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8880) NameNode metrics logging
Date Fri, 16 Oct 2015 13:27:06 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960683#comment-14960683
] 

Steve Loughran commented on HDFS-8880:
--------------------------------------

I'd be in favour of improving our own general metrics sinks, rather than adding new stuff
to every service
# it just adds more stuff to maintain, to test, to document and debug
# it's not broadly re-usable
# it adds 1/thread service, which in test runs could be many more per vm.

I note that Coda Hale metrics has a [stdout streamer|https://dropwizard.github.io/metrics/3.1.0/getting-started/]
for such purposes.

If we were to do things with metrics, codahale integration would seem a good strategy (though
the transitive LGPL dependency on the ganglia reporter is something to be aware of)

> NameNode metrics logging
> ------------------------
>
>                 Key: HDFS-8880
>                 URL: https://issues.apache.org/jira/browse/HDFS-8880
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: namenode
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>             Fix For: 2.8.0
>
>         Attachments: HDFS-8880.01.patch, HDFS-8880.02.patch, HDFS-8880.03.patch, HDFS-8880.04.patch,
namenode-metrics.log
>
>
> The NameNode can periodically log metrics to help debugging when the cluster is not setup
with another metrics monitoring scheme.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message