hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward Capriolo (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4514) Hive web interface
Date Tue, 04 Nov 2008 23:12:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12645100#action_12645100
] 

Edward Capriolo commented on HADOOP-4514:
-----------------------------------------

I have a draft/in progress version here:
http://www.jointhegrid.com/jtgwebrepo/beeswax/

HWIServer - This component reads in /conf/hwi-default.xml and /conf/hwi-set.xml starts an
embedded Jetty Server. Started by a script like the hive shell script that starts this file
rather then the CLI.
HWIContentListener - This is used to load a Runnable of HiveSessionManager,
HiveSessionManager - Container a Vector of SessionItem, this also lives in the web server
application scope
SessionItem - A Client Session state object wrapped. Status functions to block changes while
query running, etc.
All the jsp pages interact with the HiveSessionManager running in the jetty application scope.


So the hwi (Hive Web Interface) holds multiple session states. Session states would be named
by a string and optionally protected by a password. User would log in and see all sessions
in a ListSessions page. All the output from a session state would be written to a file since
we can't write it to the console, we also can not write it to a buffer as the result of a
hive query could be large. If you set the output to /dev/null none of the output stream would
be captured.

Some things I could use help with:
1) I am sure hadoop reads the configuration files a different/better way. I will have to look
at this.
2) jetty wac.setWAR SEEMS to require ANT libraries, I do not understand why really adding
them is trivial I copied /opt/ant/lib /opt/hive/lib
3) I'm using netbeans. I do not think the ant scripts it generates will be what we want in
a hadoop commit. At some point if someone wants to tell / port what I am working on to something
that fits in very tight with hadoop that would be great. I am not too familiar yet with the
hadoop/src structure.
4) Does anyone know how to extract the hadoop job names from the CLISession. The CLI used
to output them when a query started.

Does anyone have any comments? I know without front end JSP understanding the application
might be difficult, but I wanted to make sure people like/understand the Jetty-SessionListenter-Runnable
approach. 

> Hive web interface
> ------------------
>
>                 Key: HADOOP-4514
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4514
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/hive
>            Reporter: Jeff Hammerbacher
>            Priority: Minor
>
> Hive needs a web interface. The initial checkin should have:
> * simple schema browsing
> * query submission
> * query history (similar to MySQL's SHOW PROCESSLIST)
> A suggested feature: the ability to have a query notify the user when it's completed.
> Edward Capriolo has expressed some interest in driving this process.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message