hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6093) Expose more caching information for debugging by users
Date Fri, 14 Mar 2014 22:52:48 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13935771#comment-13935771
] 

Colin Patrick McCabe commented on HDFS-6093:
--------------------------------------------

Hi Aprit,

It takes time for the values reported by dfsAdmin -report and cacheadmin -listPools to converge,
since dfsAdmin comes from information taken from the DN heartbeat, and listPools comes from
information taken from the CacheReplicationMonitor.  Try waiting 5 or 10 minutes.  We might
want to shorten the default for {{dfs.namenode.path.based.cache.retry.interval.ms}} for this
reason.

> Expose more caching information for debugging by users
> ------------------------------------------------------
>
>                 Key: HDFS-6093
>                 URL: https://issues.apache.org/jira/browse/HDFS-6093
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: caching
>    Affects Versions: 2.4.0
>            Reporter: Andrew Wang
>            Assignee: Andrew Wang
>         Attachments: hdfs-6093-1.patch
>
>
> When users submit a new cache directive, it's unclear if the NN has recognized it and
is actively trying to cache it, or if it's hung for some other reason. It'd be nice to expose
a "pending caching/uncaching" count the same way we expose pending replication work.
> It'd also be nice to display the aggregate cache capacity and usage in dfsadmin -report,
since we already have have it as a metric and expose it per-DN in report output.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message