hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1957) [hbase] Web UI with report on cluster state and basic browsing of tables
Date Sat, 06 Oct 2007 04:28:50 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stack updated HADOOP-1957:
--------------------------

       Resolution: Fixed
    Fix Version/s: 0.15.0
           Status: Resolved  (was: Patch Available)

Committed. Resolved.

Below is commit message.

{code}
HADOOP-1957 Web UI with report on cluster state and basic browsing of tables

Adds a master and region server info webpp.  Apps display vital attributes,
lists of tables, regionservers, meta region locations, etc.  Master webapp has an HQL
page that allows running (read-only) queries.  The shell subpackage commands
have all been amended to take Writer -- e.g. a UTF-8'ing System.out or a JspOut --
rather than presume System.out and a TableFormatter for outputting result sets.

M src/contrib/hbase/conf/hbase-default.xml
    Added ports and address config. for master and region server info
    webapps.  Also, configuration for what HQL table formatter to use.
M  src/contrib/hbase/src/test/hbase-site.xml
    By default, do not have tests spin up info servers.
A  src/contrib/hbase/src/test/org/apache/hadoop/hbase/TestInfoServers.java
    Test that info servers spin up.
A  src/contrib/hbase/src/test/org/apache/hadoop/hbase/TestSerialization.java
    Test serialization works.  Added test of ServerInfo.
M  src/contrib/hbase/src/test/org/apache/hadoop/hbase/HBaseTestCase.java
    (tearDown, setup): returned them to the base classes protected access
M  src/contrib/hbase/src/test/org/apache/hadoop/hbase/shell/TestHBaseShell.java
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/Shell.java
   Shell parser now takes a table formatter and a Writer (Previous assumed
   System.out).
M src/contrib/hbase/src/test/org/apache/hadoop/hbase/MiniHBaseCluster.java
    (getRegionThreads): added.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/Leases.java
    Beefed up log messages.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HRegionServer.java
    Add spin-up of info server.
    (getServerInfo, getOnlineRegions, getRequestCount): Added. Called by
    info server.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HConstants.java
    Added defaults for info server ports.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/DeleteCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/CreateCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/DisableCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/InsertCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/DropCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/AlterCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/FsCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/ExitCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/JarCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/DescCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/ShowCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/EnableCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/ClearCommand.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/SchemaModificationCommand.java
    Added constructor that takes a Writer.  Removed calls to System.out.  Go
    via the passed in Writer instead.
    (getCommmandType): Added.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/TableFormatterFactory.java
    Refactored.  Reads config. to figure which table formatter to build.
D src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/HelpContents.java
    Integrated into HelpCommand.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/TableFormatter.java
    Methods changed to throw IOE.
    (getOut): Added.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/ParserTokenManager.java
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/Parser.java
    Generated.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/HBaseShell.jj
    All commands now take at least a Writer.  Some take a TableFormatter too.
    Changed Parser constructor to take Writer and TableFormatter.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/Command.java
    (getCommandType): Added.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/SelectCommand.java
    Added constructor that takes a Writer.  Removed calls to System.out.  Go
    via the passed in Writer instead. Fixed bug where if a row was specified in
    WHERE we were returning no results.
    (getCommmandType): Added.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/BasicCommand.java
    Added print and println implementations for the LCD Writer (Taking a PrintWriter
    instead would mean we'd have to wrap a stream w/ a PrintWriter -- but we do not
    always get access to stream cleanup so our PrintWriter wrapper gets undone; e.g.
    in jsp context.  Could leave hanging resources. So just use lowest common
    denominator Writer and do our own print/println).
D src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/HelpManager.java
    Moved into HelpCommand.
A  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/formatter/HtmlTableFormatter.java
    HTML table formatter.   Outputs xhtml using hadoop bundled xmlenc jar.
A  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/formatter/AsciiTableFormatter.java
    Ascii table formatter.  Made into standalone class.  Moved here from
    TableFormatterFactory inner class.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/ReturnMsg.java
    (toString): Added.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/HelpCommand.java
    Moved HelpManager and HelpContent in here.  Redid help output so instead
    uses table output (Lost some of the helpful formatting but now the help
    is portable -- can be displayed on console or in webpage).
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HServerInfo.java
    Add the infoPort to server info.
    (getInfoPort, equals, hashCode): Added.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMaster.java
    Put up an info server.
    (getRootDir, getServersToServerInfo, getServersToLoad,
      getRootRegionLocation, getOnlineMetaRegion): Added. Used by web UI.
    (startAllServices): Renamed as startServiceThread to be same as region server.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMemcache.java
    Formatting.
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/generated/regionserver/regionserver_jsp.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/generated/master/hql_jsp.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/generated/master/master_jsp.java
A src/contrib/hbase/src/webapps/regionserver/WEB-INF/web.xml
A src/contrib/hbase/src/webapps/master/WEB-INF/web.xml
    Generated.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HRegion.java
    (getRegionInfo): Made public so could be access by web UI.
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/util/InfoServer.java
    Version of StatusHttpServer that doesn't add unwanted contexts and
    assume that the jar that has StatusHttpServer is the only location
    for resources to load.
A src/contrib/hbase/src/webapps/static/hbase.css
    Basic styling.  In particular, adds borders to tables.
A src/contrib/hbase/src/webapps/master/hql.jsp
A  src/contrib/hbase/src/webapps/master/master.jsp
A src/contrib/hbase/src/webapps/regionserver/regionserver.jsp
A src/contrib/hbase/src/webapps/master/index.html
A src/contrib/hbase/src/webapps/regionserver/index.html
    Webpages.
M src/contrib/hbase/bin/hbase
    Add webapps to classpath.
A src/contrib/hbase/build-webapps.xml
    ant script to generate java classes from webapp jsps.
    Needs to be run manually and changes committed whenever
    jsp has been changed (Can't integrate into build because
    of the infamous commons-logging classloading issue).
M  src/contrib/hbase/build.xml
    Add copying over of webapps. Add webapps to classpath
{code}

> [hbase] Web UI with report on cluster state and basic browsing of tables
> ------------------------------------------------------------------------
>
>                 Key: HADOOP-1957
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1957
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: contrib/hbase
>            Reporter: stack
>            Priority: Minor
>             Fix For: 0.15.0
>
>         Attachments: ui-v2.patch, ui.patch
>
>
> Hbase should put up a simple webapp listing content of master in-memory data structures
listing cluster members, tables and other vital statistics.  Some admin facility for editing
column properties w/ table enable/disable features would also go here.  A basic (read-only?)
means of listing tables and their attributes, and for browsing table content -- perhaps w/
support for HQL queries -- would also be useful confirming uploads, debugging, etc.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message