Return-Path: X-Original-To: apmail-airavata-dev-archive@www.apache.org Delivered-To: apmail-airavata-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6C16E10A23 for ; Tue, 16 Apr 2013 06:48:22 +0000 (UTC) Received: (qmail 12900 invoked by uid 500); 16 Apr 2013 06:48:21 -0000 Delivered-To: apmail-airavata-dev-archive@airavata.apache.org Received: (qmail 12750 invoked by uid 500); 16 Apr 2013 06:48:18 -0000 Mailing-List: contact dev-help@airavata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airavata.apache.org Delivered-To: mailing list dev@airavata.apache.org Received: (qmail 12709 invoked by uid 99); 16 Apr 2013 06:48:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Apr 2013 06:48:17 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=DC_PNG_UNO_LARGO,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of danushka.menikkumbura@gmail.com designates 209.85.216.169 as permitted sender) Received: from [209.85.216.169] (HELO mail-qc0-f169.google.com) (209.85.216.169) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Apr 2013 06:48:13 +0000 Received: by mail-qc0-f169.google.com with SMTP id t2so74414qcq.28 for ; Mon, 15 Apr 2013 23:47:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=GZ2G1UJLiETzjVCTL3N9h5gn46SbAeDaufbKBtra+RE=; b=WIrayaxNFP7J4otA84QJOl+oq5d0Brur+LNzq2+njRhaFIjDxI0qV+pfiFkxvOaiZW a8tPRvVl32QQ1ISXBKLDKCQl2YoxNiNACgNBCy5FZ5Q2pA2ZfJIITWHZ4wh98v+HghHn FsfU6pQGDRqC8pNd+Tpe9lkj5U8qD+3MurUjEW7lrLeyxoONfKk9zG+PB5ImX1UbDvVh x/ZXIBKb37wL9SPLBRjZIpvLZjNWyNADdQK0SkMPE1X7dE4KSbkWE7boh6+l5aEfvCeR 7DpR6QjlV/YmnsNUz1UJJTZe4KDrJAnd3prSFgJAIfU7lVz/Uo2TeUCtw47fZmCnWk9R XirA== X-Received: by 10.49.61.226 with SMTP id t2mr1038524qer.40.1366094872294; Mon, 15 Apr 2013 23:47:52 -0700 (PDT) MIME-Version: 1.0 Received: by 10.49.82.163 with HTTP; Mon, 15 Apr 2013 23:47:32 -0700 (PDT) In-Reply-To: References: <516C1002.1060502@iu.edu> From: Danushka Menikkumbura Date: Tue, 16 Apr 2013 12:17:32 +0530 Message-ID: Subject: Re: Airavata GSOC cloud and grid service provider plugins To: dev@airavata.apache.org Content-Type: multipart/mixed; boundary=047d7bdc103297ba3404da74bfe2 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bdc103297ba3404da74bfe2 Content-Type: multipart/alternative; boundary=047d7bdc103297ba3104da74bfe0 --047d7bdc103297ba3104da74bfe0 Content-Type: text/plain; charset=ISO-8859-1 Yes. Exactly. In essence, we would have a unified plugin framework across the system, not limiting to the GFac core. Please find the attached PluginManager.png that depicts the big picture. Furthermore, in the long run we can have the plugin manager as a separate module so that even XBaya could make use of it to extend itself and with that in place we would end up writing UI plugins to extend XBaya so that adding a new UI feature is just a matter of writing a plugin and dropping it in the plugins directory. Thanks, Danushka On Tue, Apr 16, 2013 at 6:50 AM, Lahiru Gunathilake wrote: > Hi Suresh, > > I think he meant, airavat can be configured to have any transport for its > messaging, either AMQP or just WS-eventing or anything else, we just > program to the interface and any implementation configured will be executed > in a given time (like axis2 transport layer). We have similar messaging > implementation inside gfac-core but its only internal to gfac-core. > > Danushka correct me if I am wrong. > > Lahiru > > > On Mon, Apr 15, 2013 at 8:47 PM, Suresh Marru wrote: > > > Hi Danushka, > > > > Do you think this will be a GSoC project by itself? I did not get what > did > > you mean by pluggable transport messaging layer? Within GFac? > > > > The web based workflow monitor will also need some light messaging layer, > > thinking out loud. > > > > Suresh > > > > On Apr 15, 2013, at 2:01 PM, Danushka Menikkumbura < > > danushka.menikkumbura@gmail.com> wrote: > > > > > Just FYI ; I had something similar in my mind and we had a discussion > [1] > > > on dev@ few weeks back. I still believe that it would be a must-have > > > feature in Airavata. > > > > > > [1] - > > > > > > http://apache.markmail.org/message/fnujm4j4kk2h2kxu?q=Decoupling+GFac+Providers > > > > > > Thanks, > > > Danushka > > > > > > > > > On Mon, Apr 15, 2013 at 9:27 PM, Suresh Marru > wrote: > > > > > >> + 1 this is a great topic and a stand alone one by itself. > > >> > > >> A good example to watch here is what Milinda did last year [1] , he > not > > >> only added a cloud provider but fundamentally fixed the GFac > > architecture > > >> [2]. A similar goal of a concrete task of adding the provider Marlon > > >> suggested while critically reviewing the provider architecture will be > > >> great. > > >> > > >> Suresh > > >> > > >> [1] - https://issues.apache.org/jira/browse/AIRAVATA-357 > > >> [2] - https://issues.apache.org/jira/browse/AIRAVATA-477 > > >> > > >> On Apr 15, 2013, at 10:34 AM, Marlon Pierce wrote: > > >> > > >>> -----BEGIN PGP SIGNED MESSAGE----- > > >>> Hash: SHA1 > > >>> > > >>> Hi all-- > > >>> > > >>> There has been some great discussion on GSOC projects involving > > >>> JS/HTML5/REST/etc user interface environments. These will be great > > >>> for exercising the Airavata API and evaluating the best ways to wrap > > >>> it as a service. > > >>> > > >>> There's also been a lot of work put into redesigning the GFAC > > >>> component to make it easier to provide plugins. It would be great if > > >>> we could identify projects that exercise this as well and make a wide > > >>> range of new plugins in the process. Some possibilities: > > >>> > > >>> * Azure and other cloud provider plugins to complement the EC2 > plugin. > > >>> > > >>> * Open Science Grid-based plugins. These may be interesting for > > >>> anyone who has or wants to set up a campus grid > > >>> (https://twiki.grid.iu.edu/bin/view/CampusGrids/WebHome). > > >>> > > >>> * JSDL/BES-based service providers. JSDL and BES are Open Grid Forum > > >>> standards for running jobs on high performance computers. UNICORE > and > > >>> SAGA are a couple of implementations. > > >>> > > >>> More creative suggestions for plugins are also welcome. > > >>> > > >>> > > >>> Marlon > > >>> -----BEGIN PGP SIGNATURE----- > > >>> Version: GnuPG/MacGPG2 v2.0.18 (Darwin) > > >>> Comment: GPGTools - http://gpgtools.org > > >>> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ > > >>> > > >>> iQEcBAEBAgAGBQJRbBACAAoJEOEgD2XReDo5/GcH/RLPW1JeNOI9s0YWWCDh1yWR > > >>> jHLOrDg+HzvHlinDfH56earbL0z28Sc+VcN5lkEdgBa35JXMjcZvzmynT3dDEBUH > > >>> BIsFM+iqYH4B1fxg8NZ6BsqschosTdVw2JZu8sGapML9m/MOFAIkxB0XLJ6FGyst > > >>> Dp3QIVsZL7H5MXl8K9K2efx12qj5lCdKzwzRt1LH+tbSCcpnoeXs8BcnG6jB9kQ4 > > >>> Q0pLvgQxsTIP2RlapS8SgcZggzdpdKNWimfM1VxBHpcwwIJTzK3LXt17XVeZ/Zan > > >>> 4K7lJamUkYWCmptFWkyoyzoOrb4h5zsFoNFWsFd8moKefyDjHMcEG9rbhLHyGfk= > > >>> =9SId > > >>> -----END PGP SIGNATURE----- > > >> > > >> > > > > > > > -- > System Analyst Programmer > PTI Lab > Indiana University > --047d7bdc103297ba3104da74bfe0 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Yes. Exactly.

In essence, we w= ould have a unified plugin framework across the system, not limiting to the= GFac core.

Please find the attached PluginManager.png that de= picts the big picture.

Furthermore, in the long run we can have the plugin manager = as a separate module so that even XBaya could make use of it to extend itse= lf and with that in place we would end up writing UI plugins to extend XBay= a so that adding a new UI feature is just a matter of writing a plugin and = dropping it in the plugins directory.

Thanks,
Danushka
=A0


On Tue, A= pr 16, 2013 at 6:50 AM, Lahiru Gunathilake <glahiru@gmail.com> wrote:
Hi Suresh,

I think he meant, airavat can be configured to have any transport for its messaging, either AMQP or just WS-eventing or anything else, we just
program to the interface and any implementation configured will be executed=
in a given time (like axis2 transport layer). We have similar messaging
implementation inside gfac-core but its only internal to gfac-core.

Danushka correct me if I am wrong.

Lahiru


On Mon, Apr 15, 2013 at 8:47 PM, Suresh Marru <smarru@apache.org> wrote:

> Hi Danushka,
>
> Do you think this will be a GSoC project by itself? I did not get what= did
> you mean by pluggable transport messaging layer? Within GFac?
>
> The web based workflow monitor will also need some light messaging lay= er,
> thinking out loud.
>
> Suresh
>
> On Apr 15, 2013, at 2:01 PM, Danushka Menikkumbura <
> danushka.menikkumbu= ra@gmail.com> wrote:
>
> > Just FYI ; I had something similar in my mind and we had a discus= sion [1]
> > on dev@ few weeks back. I still believe that it would be a must-h= ave
> > feature in Airavata.
> >
> > [1] -
> >
> http://apache.markmail.org/messag= e/fnujm4j4kk2h2kxu?q=3DDecoupling+GFac+Providers
> >
> > Thanks,
> > Danushka
> >
> >
> > On Mon, Apr 15, 2013 at 9:27 PM, Suresh Marru <smarru@apache.org> wrote:
> >
> >> + 1 this is a great topic and a stand alone one by itself. > >>
> >> A good example to watch here is what Milinda did last year [1= ] , he not
> >> only added a cloud provider but fundamentally fixed the GFac<= br> > architecture
> >> [2]. A similar goal of a concrete task of adding the provider= Marlon
> >> suggested while critically reviewing the provider architectur= e will be
> >> great.
> >>
> >> Suresh
> >>
> >> [1] - https://issues.apache.org/jira/browse/AIRAVATA-35= 7
> >> [2] - https://issues.apache.org/jira/browse/AIRAVATA-47= 7
> >>
> >> On Apr 15, 2013, at 10:34 AM, Marlon Pierce <marpierc@iu.edu> wrote:
> >>
> >>> -----BEGIN PGP SIGNED MESSAGE-----
> >>> Hash: SHA1
> >>>
> >>> Hi all--
> >>>
> >>> There has been some great discussion on GSOC projects inv= olving
> >>> JS/HTML5/REST/etc user interface environments. =A0These w= ill be great
> >>> for exercising the Airavata API and evaluating the best w= ays to wrap
> >>> it as a service.
> >>>
> >>> There's also been a lot of work put into redesigning = the GFAC
> >>> component to make it easier to provide plugins. =A0It wou= ld be great if
> >>> we could identify projects that exercise this as well and= make a wide
> >>> range of new plugins in the process. =A0Some possibilitie= s:
> >>>
> >>> * Azure and other cloud provider plugins to complement th= e EC2 plugin.
> >>>
> >>> * Open Science Grid-based plugins. =A0These may be intere= sting for
> >>> anyone who has or wants to set up a campus grid
> >>> (https://twiki.grid.iu.edu/bin/view/CampusGrids= /WebHome).
> >>>
> >>> * JSDL/BES-based service providers. JSDL and BES are Open= Grid Forum
> >>> standards for running jobs on high performance computers.= =A0UNICORE and
> >>> SAGA are a couple of implementations.
> >>>
> >>> More creative suggestions for plugins are also welcome. > >>>
> >>>
> >>> Marlon
> >>> -----BEGIN PGP SIGNATURE-----
> >>> Version: GnuPG/MacGPG2 v2.0.18 (Darwin)
> >>> Comment: GPGTools - http://gpgtools.org
> >>> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
> >>>
> >>> iQEcBAEBAgAGBQJRbBACAAoJEOEgD2XReDo5/GcH/RLPW1JeNOI9s0YWW= CDh1yWR
> >>> jHLOrDg+HzvHlinDfH56earbL0z28Sc+VcN5lkEdgBa35JXMjcZvzmynT= 3dDEBUH
> >>> BIsFM+iqYH4B1fxg8NZ6BsqschosTdVw2JZu8sGapML9m/MOFAIkxB0XL= J6FGyst
> >>> Dp3QIVsZL7H5MXl8K9K2efx12qj5lCdKzwzRt1LH+tbSCcpnoeXs8BcnG= 6jB9kQ4
> >>> Q0pLvgQxsTIP2RlapS8SgcZggzdpdKNWimfM1VxBHpcwwIJTzK3LXt17X= VeZ/Zan
> >>> 4K7lJamUkYWCmptFWkyoyzoOrb4h5zsFoNFWsFd8moKefyDjHMcEG9rbh= LHyGfk=3D
> >>> =3D9SId
> >>> -----END PGP SIGNATURE-----
> >>
> >>
>
>


--
System Analyst Programmer
PTI Lab
Indiana University

--047d7bdc103297ba3104da74bfe0-- --047d7bdc103297ba3404da74bfe2--