Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CF75691AD for ; Wed, 11 Jan 2012 11:15:24 +0000 (UTC) Received: (qmail 47232 invoked by uid 500); 11 Jan 2012 11:15:23 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 46833 invoked by uid 500); 11 Jan 2012 11:15:00 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 46571 invoked by uid 99); 11 Jan 2012 11:14:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Jan 2012 11:14:48 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of joey@cloudera.com designates 209.85.216.176 as permitted sender) Received: from [209.85.216.176] (HELO mail-qy0-f176.google.com) (209.85.216.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Jan 2012 11:14:39 +0000 Received: by qcsg1 with SMTP id g1so363692qcs.35 for ; Wed, 11 Jan 2012 03:14:18 -0800 (PST) Received: by 10.229.78.68 with SMTP id j4mr8805161qck.37.1326280458476; Wed, 11 Jan 2012 03:14:18 -0800 (PST) Received: from [192.168.6.205] ([12.50.84.194]) by mx.google.com with ESMTPS id a19sm2978675qau.21.2012.01.11.03.14.16 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 11 Jan 2012 03:14:17 -0800 (PST) References: <1326266580.13683.androidMobile@web39406.mail.mud.yahoo.com> In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: 7bit Content-Type: multipart/alternative; boundary=Apple-Mail-CF04D93B-0CED-46AB-A11D-0109FF3DAA7F Message-Id: <09B5F742-58A1-4EAD-BF8E-27291418025D@cloudera.com> Cc: "hdfs-user@hadoop.apache.org" X-Mailer: iPad Mail (9A405) From: Joey Echeverria Subject: Re: Re : Custom web app Date: Wed, 11 Jan 2012 06:14:16 -0500 To: "hdfs-user@hadoop.apache.org" --Apple-Mail-CF04D93B-0CED-46AB-A11D-0109FF3DAA7F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Take a look at Hue, it a web app that does exactly what you're talking about= . It uses a combination of RPC calls and other public APIs as well as a cust= om plugin that adds additional APIs via thrift.=20 Hue can be deployed on any node and is mostly written in Python.=20 -Joey On Jan 11, 2012, at 2:32, Michael Lok wrote: > Hi Franck, >=20 > Thanks for the info. However, I'm looking at decoupling this app from the= embedded Jetty in Hadoop. Ideally, it should be deployed in a separate ser= ver as the NameNode. Is this possible? >=20 >=20 >=20 >=20 > On Wed, Jan 11, 2012 at 3:23 PM, Franck Besnard wrote= : > Hello > Yes this is quite trivial and for example ibm did that in their big insigh= ts flavor of hadoop > The hadoop alrzady has quite a lot of instrumentation regarding monitoring= and you can extend the embedded jetty to add more features. > Ideally this webapp should nit be bundled within the nodes but that s the w= ay it is > Cheers > Franck >=20 >=20 >=20 > Envoy=C3=A9 =C3=A0 partir de Yahoo! Mail (sur Android) >=20 >=20 > From: Michael Lok ;=20 > To: ;=20 > Subject: Custom web app=20 > Sent: Wed, Jan 11, 2012 7:07:39 AM=20 >=20 > Hi folks, >=20 > I was wondering if it's possible to develop a custom front end which > allows monitoring/management of jobs/tasks and hdfs. =46rom what i can > see from the built in webapp, all JSPs retrieve the relevant > NameNode/TaskTracker objects from the application instance; which is > set during NameNode creation. Was wondering if it's possible to > connect to a remote NameNode from an external server and application > using Hadoop's API classes. >=20 >=20 > Thanks. >=20 --Apple-Mail-CF04D93B-0CED-46AB-A11D-0109FF3DAA7F Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
Take a look at Hue, it a w= eb app that does exactly what you're talking about. It uses a combination of= RPC calls and other public APIs as well as a custom plugin that adds additi= onal APIs via thrift. 

Hue can be deployed on a= ny node and is mostly written in Python. 

-Joe= y



On Jan 11, 2012, at 2:32, Michael Lok <fulat2k@gmail.com> wrote:

Hi Franck,

Thanks for the i= nfo.  However, I'm looking at decoupling this app from the embedded Jet= ty in Hadoop.  Ideally, it should be deployed in a separate server as t= he NameNode.  Is this possible?




On Wed, Jan 11, 2012 at 3:23 PM, Franck B= esnard <besn0847@= yahoo.com> wrote:

Hello
Yes this is quite trivial and for example ibm did that in their big insights= flavor of hadoop
The hadoop alrzady has quite a lot of instrumentation regarding monitoring a= nd you can extend the embedded jetty to add more features.
Ideally this webapp should nit be bundled within the nodes but that s the wa= y it is
Cheers
Franck


Envoy=C3=A9 =C3=A0 partir de Yahoo! Mail (sur Android)


From: Michael Lok <fulat2k@gmail.com>; =
To: <hdfs-user@hadoop.apache.org>; = =
Subject: Custom web app
Sent: Wed, Jan 11, 2012 7:07:39 AM =

Hi folks,

I was wondering if it's possible to develop a custom f= ront end which
allows monitoring/management of jobs/tasks and hdfs. = =46rom what i can
see from the built in webapp, all JSPs retrieve the relevant
NameNode/Tas= kTracker objects from the application instance; which is
set during NameN= ode creation.  Was wondering if it's possible to
connect to a remote= NameNode from an external server and application
using Hadoop's API classes.


Thanks.

= --Apple-Mail-CF04D93B-0CED-46AB-A11D-0109FF3DAA7F--