hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tanping Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1873) Federation Cluster Management Web Console
Date Sun, 01 May 2011 23:15:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13027510#comment-13027510
] 

Tanping Wang commented on HDFS-1873:
------------------------------------

Philip,
Thank you very much for your comments!  
Regarding to (1), we chose to use JMX, but not others, the reason can be referred back to
HDFS-1318.  Started in HDFS-1318, we exposed the name node and data node statistics using
JMX (the same information is exposed on JSP pages over HTTP), so that we can provide structured
information to help building and scripting around the exposed statistics.  The new Federation
web management UI are built based on JMX, its content is in the format of XML.  Beyond viewing
the cluster management console web page, one can choose to write a parser to parse the XML
or directly query name nodes or data nodes through JMX to get structured statistics back in
order to monitor the cluster.
Regarding to (2), your concern is valid!  We are working on how to address the security related
details now.  The initial idea is to read the information through JMX with no writing.  
Regarding to (3), I wanted to make the JMX port number configurable in hdfs-site.xml along
with other properties.  I was not able to find a better way to read the property and set it
into hadoop-env.sh.  The other way that I thought of was to set the jmx port system property
in a configuration file.  But I felt that having an extra configuration file is a bad idea.
 

> Federation Cluster Management Web Console
> -----------------------------------------
>
>                 Key: HDFS-1873
>                 URL: https://issues.apache.org/jira/browse/HDFS-1873
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>    Affects Versions: 0.23.0
>            Reporter: Tanping Wang
>            Assignee: Tanping Wang
>             Fix For: 0.23.0
>
>         Attachments: ClusterSummary.png, Decommission.png, HDFS-1873.patch
>
>
> The Federation cluster management console provides 
> # Cluster summary information that shows overall cluster utilization.  A list of the
name nodes that reports the used space, files and directories, blocks, live and dead datanodes

> of each name space.
> # decommissioning status of all the data nodes who are decommissioning in process or
decommissioned.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message