Return-Path: X-Original-To: apmail-ambari-user-archive@www.apache.org Delivered-To: apmail-ambari-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ECA0511F98 for ; Thu, 3 Jul 2014 01:22:02 +0000 (UTC) Received: (qmail 21877 invoked by uid 500); 3 Jul 2014 01:22:02 -0000 Delivered-To: apmail-ambari-user-archive@ambari.apache.org Received: (qmail 21846 invoked by uid 500); 3 Jul 2014 01:22:02 -0000 Mailing-List: contact user-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ambari.apache.org Delivered-To: mailing list user@ambari.apache.org Received: (qmail 21834 invoked by uid 99); 3 Jul 2014 01:22:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jul 2014 01:22:02 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yusaku@hortonworks.com designates 209.85.217.179 as permitted sender) Received: from [209.85.217.179] (HELO mail-lb0-f179.google.com) (209.85.217.179) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jul 2014 01:22:00 +0000 Received: by mail-lb0-f179.google.com with SMTP id z11so8406017lbi.24 for ; Wed, 02 Jul 2014 18:21:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=1KSajx1m2qEBxIX69GcgKaNvs/BgRq/qPb2DSGj0kaw=; b=koRU9Kp/AZLaE1rhXm/45ViPlpQxesV2aIQUARQ/9D856b7Qpz3l4ji3zg05m4wY9H VXqf9XDkkfpsWn+NryNKebq5UHwjGnMB0bXhNjpfAJQI6merInxXq8xq1DhanbKqiCs3 v3DWixK2rYMNcrv5yT/vTWxYL2UgX2G5sOyXrcG1ojiVlXo7RI8lJGK8LRh+oRJailT+ EXXjBIY5E4MzVEMuTxw6gbUtj2AUgQEqKf4EOku2KyPv950Px8k5ph4sVnClRxfrtMlv SgpBCuYig7JQC2tFcM5OtY3EoGtsOXIEjEhHovSOnqOGxi3V/x9fllgnngRFQUiVAtH9 SRig== X-Gm-Message-State: ALoCoQkb4ecmj9TXqUJbdA+/OGYHhg5HkDtXbdGSgmrPNuTaZjcfnQb0bXk1IKTBBeYMD8Q7zxK8/hTcyQlBK6EgHmmTKqUd2FFaE052ILqy7Hx1+CeQ8v0= MIME-Version: 1.0 X-Received: by 10.112.149.71 with SMTP id ty7mr1017765lbb.34.1404350496664; Wed, 02 Jul 2014 18:21:36 -0700 (PDT) Received: by 10.112.93.168 with HTTP; Wed, 2 Jul 2014 18:21:36 -0700 (PDT) In-Reply-To: <1403719056.32081.YahooMailNeo@web125806.mail.ne1.yahoo.com> References: <1403294893.60873.YahooMailNeo@web125803.mail.ne1.yahoo.com> <1403719056.32081.YahooMailNeo@web125806.mail.ne1.yahoo.com> Date: Wed, 2 Jul 2014 18:21:36 -0700 Message-ID: Subject: Re: Stand alone Ambari set up From: Yusaku Sako To: user@ambari.apache.org, Yixiao Lin Content-Type: multipart/alternative; boundary=047d7b3a8ada7e8ae404fd3fd4f6 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b3a8ada7e8ae404fd3fd4f6 Content-Type: text/plain; charset=UTF-8 Hi Yixiao, I'm sorry about my late response. If I understand what you want to do correctly, here is be a summary of what you need to do: * Create Job Monitoring View that takes a YARN Application Timeline Server URI (as an example, or any other endpoint you need to expose info needed for the View) * Install Ambari Server on some host * Deploy Job Monitoring View on the Ambari Server * Create one instance of the View for each cluster you want to monitor jobs for * For each instance, set the appropriate YARN Application Timeline Server URI * Grant access to Job Monitoring View instances for certain users/groups * Users can log in and access your Job Monitoring View for specific clusters to which they are granted access You would not need to install agents on the clusters you want to monitor jobs for. Yusaku On Wed, Jun 25, 2014 at 10:57 AM, Yixiao Lin wrote: > Hi, Yusaku > > Thank you for your reply. So I have looked at the links you included, they > are helpful. However, it doesn't seem clear to me how the monitoring is > done between the ambari server and the clusters, do I need to install > agents on these Clusters? Is there a example that performs communicating > between the ambari server and the clusters or the agents on the Clusters? > Is there is, I can try to build a view based on that. > > Thank you very much > Yixiao > > > On Monday, June 23, 2014 5:29 PM, Yusaku Sako > wrote: > > > Hi Yixiao, > > Yes, the use case mentioned will be possible with Ambari Views. > Ambari Views is a framework that allows UIs to be developed in a > pluggable manner. > Such UI plugins are called "Views" and they can be embedded in Ambari > Web UI and made accessible to specific users/group members. > One use case of Ambari Views is to have Ambari Server run in > "stand-alone mode", where the user need not have deployed any cluster > via Ambari itself, but still allow users to access Views by logging in > to Ambari (via local user store or LDAP). A job monitoring View can > be configured to show job monitoring UI based on pointers to existing > clusters that were not necessarily deployed via Ambari. > For an overview, please see [1] and [2] > > [1] http://www.slideshare.net/hortonworks/ambari-views-overview > [2] https://cwiki.apache.org/confluence/display/AMBARI/Views > > Yusaku > > On Fri, Jun 20, 2014 at 1:08 PM, Yixiao Lin wrote: > > Hi all, > > > > This is Yixiao Lin from Yahoo. I want to use Ambari server to monitor my > > jobs on my own deployment of Hadoop. I don't want to install Hadoop from > > Ambari and I don't want to install any agents. Is that possible? If so, > > please point me to a documentation of how to set up that. If not, please > let > > me know why. > > > > Thank you in advance. > > > > Best, > > Yixiao Lin > > > > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified > that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender > immediately > and delete it from your system. Thank You. > > > > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. --047d7b3a8ada7e8ae404fd3fd4f6 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Yixiao,

I'm sorry about my late = response.
If I understand what you want to do correctly, here is = be a summary of what you need to do:

* Create Job = Monitoring View that takes a YARN Application Timeline Server URI (as an ex= ample, or any other endpoint you need to expose info needed for the View)
* Install Ambari Server on some host
* Deploy Job Monitoring= View on the Ambari Server
* Create one instance of the View for = each cluster you want to monitor jobs for
* For each instance, se= t the appropriate YARN Application Timeline Server URI
* Grant access to Job Monitoring View instances for certain users/grou= ps
* Users can log in and access your Job Monitoring View for spe= cific clusters to which they are granted access

You would not need to install agents on the clusters you want to monitor jo= bs for.

Yusaku


=


On Wed,= Jun 25, 2014 at 10:57 AM, Yixiao Lin <yixiao@yahoo-inc.com> wrote:
Hi, Yusaku

Thank you for your reply. So I have looked at the links you incl= uded, they are helpful. However, it doesn't seem clear to me how the mo= nitoring is done between the ambari server and the clusters, do I need to i= nstall agents on these Clusters? Is there a example that performs communica= ting between the ambari server and the clusters or the agents on the Cluste= rs? Is there is, I can try to build a view based on that.

Thank you very much
Yixiao=C2= =A0


On Monday, June 23, 2014 5= :29 PM, Yusaku Sako <yusaku@hortonworks.com> wrote:
=20

Hi Yixiao,

Yes, the use case ment= ioned will be possible with Ambari Views.
Ambari Views is= a framework that allows UIs to be developed in a
pluggable manner.
Such UI plugins are called "Views" and they can be em= bedded in Ambari
Web UI and made accessible to specific u= sers/group members.
One use case of Ambari Views is to have Ambari Server run in
"stand-alone mode", where the user need not have deployed any= cluster
via Ambari itself, but still allow users to acce= ss Views by logging in
to Ambari (via local user store or LDAP).=C2=A0 A job monitoring View canbe configured to show job monitoring UI based on pointers = to existing
clusters that were not necessarily deployed v= ia Ambari.
For an overview, please see [1] and [2]

[1] http://www.slideshare.= net/hortonworks/ambari-views-overview
[2] https://cwiki.apache.org/co= nfluence/display/AMBARI/Views

Yusa= ku

On Fri, Jun 20, 2014 at 1:08 PM, Yixiao Lin <yixiao@yahoo-inc.com> wrote:
> Hi a= ll,
>
> This is Yixiao Lin from Yahoo. I want to use Am= bari server to monitor my
> jobs on my own deployment = of Hadoop. I don't want to install Hadoop from
> A= mbari and I don't want to install any agents. Is that possible? If so,
> please point me to= a documentation of how to set up that. If not, please let
> me know why.
>
> Thank you in advance.
>
> Best,
> Yixiao Lin

>

--
CONFIDENTIALITY NOTICE
NOTICE: T= his message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law.= If the reader
of this message is not the intended recip= ient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you h= ave
received this communication in error, please contact= the sender immediately
and delete it from your system. Thank You.





CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u. --047d7b3a8ada7e8ae404fd3fd4f6--