hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Boudnik (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-2093) Herriot JT and TT clients should vend statistics
Date Tue, 28 Sep 2010 00:15:35 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Konstantin Boudnik updated MAPREDUCE-2093:

        Summary: Herriot JT and TT clients should vend statistics  (was: CLONE -Herriot NN
and DN clients should vend statistics)
    Description: Mapreduce counterpart of HDFS-1408  (was: The HDFS web user interface serves
useful information through dfshealth.jsp and dfsnodelist.jsp.

The Herriot interface to the namenode and datanode (as implemented in NNClient and DNClient,
respectively) would benefit from the addition of some way to channel this information. In
the case of DNClient this can be an injected method that returns a DatanodeDescriptor relevant
to the underlying datanode.

There seems to be no analagous NamenodeDescriptor. It may be useful to add this as a facade
to a visitor that aggregates values across the filesystem datanodes. These values are (from
dfshealth JSP):

Configured Capacity
DFS Used
Non DFS Used
DFS Remaining
DFS Used%
DFS Remaining%
Live Nodes
Dead Nodes
Decommissioning Nodes
Number of Under-Replicated Blocks

Attributes reflecting the web user interface header may also be useful such as When-Started,
Version, When-Compiled, and Upgrade-Status.

A NamenodeDescriptor would essentially "push down" the code in dfshealth web UI behind a more
general abstraction. If it is objectionable to make this class available in HDFS, perhaps
this could be packaged in a Herriot specific way.)

> Herriot JT and TT clients should vend statistics
> ------------------------------------------------
>                 Key: MAPREDUCE-2093
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2093
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: test
>    Affects Versions: 0.22.0
>            Reporter: Konstantin Boudnik
>            Assignee: Konstantin Boudnik
> Mapreduce counterpart of HDFS-1408

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message