Return-Path: X-Original-To: apmail-airavata-dev-archive@www.apache.org Delivered-To: apmail-airavata-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B739417EB4 for ; Thu, 16 Oct 2014 22:47:23 +0000 (UTC) Received: (qmail 5423 invoked by uid 500); 16 Oct 2014 22:47:23 -0000 Delivered-To: apmail-airavata-dev-archive@airavata.apache.org Received: (qmail 5291 invoked by uid 500); 16 Oct 2014 22:47:23 -0000 Mailing-List: contact dev-help@airavata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airavata.apache.org Delivered-To: mailing list dev@airavata.apache.org Received: (qmail 5269 invoked by uid 99); 16 Oct 2014 22:47:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Oct 2014 22:47:23 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of shameerainfo@gmail.com designates 209.85.215.49 as permitted sender) Received: from [209.85.215.49] (HELO mail-la0-f49.google.com) (209.85.215.49) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Oct 2014 22:47:19 +0000 Received: by mail-la0-f49.google.com with SMTP id q1so3744023lam.36 for ; Thu, 16 Oct 2014 15:46:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=pSS2jo5mB0X/6rkBdSpdHb/WgfIHOXb3P6chCC8POFo=; b=vXYW0VmrrOZ7V2ZnYe/nEhd9eh5+wj123dbtVTQq5isgarpyKwvGHncpP6NJdcunB4 bNk4HjvfbY0EflVPzI0hqJnaoaIYNuo1cN55r8aNYJjMuR5juneB7RNVlC0BfCwnrPff iKZCWomY5o+LblW7DzzGXGXDChOaN/ZCvk6n+U3tnq1vn6s4iBA3g7e+WDBI3poEEjNH 87YDHXEORXHzPNVdUK/1xEgY0eQoANdPefVcT3RR3Y037cyCX+u57HuAC4AaMNi2YFoY QsHBMKsTJxSHBY9XFgz3emm6iwysSN2IIzfdVKFv1RXNqrOmUXdJBiFHXhrMf+9LTNwi pMDg== X-Received: by 10.112.146.5 with SMTP id sy5mr4590111lbb.97.1413499617633; Thu, 16 Oct 2014 15:46:57 -0700 (PDT) MIME-Version: 1.0 Received: by 10.25.217.66 with HTTP; Thu, 16 Oct 2014 15:46:36 -0700 (PDT) In-Reply-To: References: <4B3A58EE-54EF-4FE9-A3DA-8EE876299430@apache.org> From: Shameera Rathnayaka Date: Thu, 16 Oct 2014 18:46:36 -0400 Message-ID: Subject: Re: Evaluate Suitable Scientific Workflow Language for Airavata. To: dev Cc: "Alek Jones (Indiana)" , Suresh Marru , "architecture@airavata.apache.org" , "dev@oodt.apache.org" Content-Type: multipart/alternative; boundary=047d7b3a87b8996c7f0505920659 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b3a87b8996c7f0505920659 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Supun, Considering we are going to provide web base GUI support and JavaScript is a well-known client side language, I would select JavaScript over Python. I am not much familiar with Python, so would like to know the advantages we get by selecting python here. Thanks, Shameera. On Thu, Oct 16, 2014 at 6:30 PM, Supun Kamburugamuva wrote: > Hi Shameera, > > Why you prefer JavaScript over a language like Python? > > Thanks, > Supun.. > > On Thu, Oct 16, 2014 at 6:25 PM, Shameera Rathnayaka < > shameerainfo@gmail.com> wrote: > >> =E2=80=8BHi, >> >> First of all thanks everyone for giving valuable inputs. After doing som= e >> background search and talking to different people in the University who = has >> used different workflow languages, I myself convinced that introducing a= n >> another workflow language is not what actually they need. By changing >> exiting workflow language to another will not solve problems. What they >> asking is a easy way to construct the workflows. Indirectly what they >> asking for a sort of API which they can use to generate the workflows an= d >> run it. Correct me if i am wrong here. >> >> As most of above replies depict, if we can get a simple API, as an >> example, for a web based application, JavaScript API would be a good >> solution, and probably JSON would be a good candidate for language, inst= ead >> of XML. >> >> Airavata community already have started to implement web base GUI. Hence >> introducing a JSON base JavaScript API would be great help. WDYT? >> >> Thanks, >> Shameera. >> >> >> On Fri, Sep 19, 2014 at 5:01 PM, Aleksander Slominski (NY) < >> alekny7@gmail.com> wrote: >> >>> Hi, >>> >>> it is not dataflow instead focused on orchestrating REST services but >>> you may find it useful datapoint - we created worfklow service that use= s >>> natively JavaScript and JSON to describe what happens during workflow >>> execution: >>> https://www.ng.bluemix.net/docs/#services/workflow/index.html#coewf002 >>> >>> HTH, >>> >>> Alek >>> >>> On Thu, Sep 18, 2014 at 1:54 PM, Suresh Marru wrote= : >>> >>>> Hi Chris, >>>> >>>> Great to hear OODT community will be interested in adopting a JSON >>>> based workflow language and potentially a web based composer as well. >>>> Airavata previously had BPEL support initially through a home grown >>>> implementation [1] by Alek Slominski and later through Apache ODE [2].= Also >>>> a white paper [3] by Alek on this topic is an interesting read. >>>> >>>> I am of the same opinion that we should adopt something more modern as >>>> the challenges from scientific workflows seems to be converging with t= he >>>> data flow patterns in business workflows. >>>> >>>> It will be great if we can all compile a list of potential candidates >>>> and hack them through. >>>> >>>> Suresh >>>> [1] - >>>> http://link.springer.com/chapter/10.1007%2F978-1-84628-757-2_14#page-1 >>>> [2] - >>>> http://www.academia.edu/1485773/Experience_with_adapting_a_WS-BPEL_run= time_for_eScience_workflows >>>> [3] - >>>> http://www.computer.org/csdl/proceedings/services/2010/4129/00/4129a32= 6.pdf >>>> >>>> >>>> On Sep 18, 2014, at 1:15 PM, Mattmann, Chris A (3980) < >>>> chris.a.mattmann@jpl.nasa.gov> wrote: >>>> >>>> > Hi Guys, >>>> > >>>> > I've been interested in this too - we don't per have a specific >>>> > OODT workflow language, but we specific workflows using XML, and >>>> > other configuration (we are also thinking of moving to JSON for >>>> > this). >>>> > >>>> > In the past I've also looked at YAWL and BPEL - both seem complex >>>> > to me. >>>> > >>>> > I wonder at the end of the day if we should adopt something more >>>> > modern like PIG or some other data flow type of language (PIG >>>> > is really neat). >>>> > >>>> > Cheers, >>>> > Chris >>>> > >>>> > >>>> > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>> > Chris Mattmann, Ph.D. >>>> > Chief Architect >>>> > Instrument Software and Science Data Systems Section (398) >>>> > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >>>> > Office: 168-519, Mailstop: 168-527 >>>> > Email: chris.a.mattmann@nasa.gov >>>> > WWW: http://sunset.usc.edu/~mattmann/ >>>> > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>> > Adjunct Associate Professor, Computer Science Department >>>> > University of Southern California, Los Angeles, CA 90089 USA >>>> > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > >>>> > -----Original Message----- >>>> > From: Shameera Rathnayaka >>>> > Reply-To: "architecture@airavata.apache.org" >>>> > >>>> > Date: Thursday, September 18, 2014 8:26 AM >>>> > To: "architecture@airavata.apache.org" < >>>> architecture@airavata.apache.org>, >>>> > dev >>>> > Subject: Evaluate Suitable Scientific Workflow Language for Airavata= . >>>> > >>>> >> Hi All, >>>> >> >>>> >> As we all know Airavata has its own workflow language call XWF. Whe= n >>>> XWF >>>> >> was introduced, main focus points are interoperability and >>>> convertibility. >>>> >> But with years of experience it is convinced that above requirement= s >>>> are >>>> >> not really useful when we come to real world use cases. And XWF is >>>> XML >>>> >> based bulky language where we attache WSDLs and Workflow image it >>>> self. >>>> >> But >>>> >> with the recent changes WSDL part is being removed from XWF. >>>> >> >>>> >> It is worth to evaluate handy Scientific workflow languages in >>>> industry >>>> >> and >>>> >> find out pros and cons, at the end of this evaluation we need to >>>> come up >>>> >> with idea how we should improve Airavata workflow language, either >>>> we can >>>> >> improve existing XWF language, totally change to a new language >>>> available >>>> >> in industry or write a new light weight language. Basic requirement= s >>>> that >>>> >> we expect from new improvement are, high usability, flexible, light >>>> weight >>>> >> and real time monitoring support. As you can see above requirements >>>> are >>>> >> not >>>> >> direct comes with workflow languages but we need workflow language >>>> which >>>> >> help to support above requirements. >>>> >> >>>> >> After reading few papers and googling, initially i have come up wit= h >>>> >> following three existing languages, >>>> >> 1. YAWL >>>> >> 2. WS-BPEL >>>> >> =E2=80=8B3. SIDL >>>> >> >>>> >> >>>> >> In my opinion SIDL is more familiar with scientific domain, >>>> Radical-SAGA >>>> >> also uses slightly modified version of SIDL. Other than above three >>>> >> languages we can come up with simple workflow language base on >>>> json(or >>>> >> yaml) which support all our requirements for some extends. >>>> >> >>>> >> It would be grate if I can get more input regarding the $Subject >>>> form the >>>> >> airavata community. You all are more than welcome to provide any >>>> type of >>>> >> suggestions. >>>> >> >>>> >> Thanks, >>>> >> Shameera. >>>> >> >>>> >> =E2=80=8B >>>> >> >>>> >> -- >>>> >> Best Regards, >>>> >> Shameera Rathnayaka. >>>> >> >>>> >> email: shameera AT apache.org , shameerainfo AT gmail.com >>>> >> Blog : http://shameerarathnayaka.blogspot.com/ >>>> >>>> >>> >>> >>> -- >>> The best way to predict the future is to invent it - Alan Kay >>> >> >> >> >> -- >> Best Regards, >> Shameera Rathnayaka. >> >> email: shameera AT apache.org , shameerainfo AT gmail.com >> Blog : http://shameerarathnayaka.blogspot.com/ >> > > > > -- > Supun Kamburugamuva > Member, Apache Software Foundation; http://www.apache.org > E-mail: supun06@gmail.com; Mobile: +1 812 369 6762 > Blog: http://supunk.blogspot.com > > --=20 Best Regards, Shameera Rathnayaka. email: shameera AT apache.org , shameerainfo AT gmail.com Blog : http://shameerarathnayaka.blogspot.com/ --047d7b3a87b8996c7f0505920659 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi = Supun,=C2=A0
Considering = we are going to provide web base GUI support and =C2=A0JavaScript is a well= -known client side language, I would select JavaScript over Python. I am no= t much familiar with Python, so would like to know the advantages we get by= selecting python here.=C2=A0


Thank= s,=C2=A0
Shamee= ra.

On= Thu, Oct 16, 2014 at 6:30 PM, Supun Kamburugamuva <supun06@gmail.com&= gt; wrote:
Hi Sha= meera,

Why you prefer JavaScript over a language like Py= thon?

Thanks,
Supun..

O= n Thu, Oct 16, 2014 at 6:25 PM, Shameera Rathnayaka <<= a href=3D"mailto:shameerainfo@gmail.com" target=3D"_blank">shameerainfo@gma= il.com> wrote:
=E2=80=8BHi,=C2= =A0

<= div class=3D"gmail_default" style=3D"font-size:small">First of all thanks e= veryone for giving valuable inputs. After doing some background search and = talking to different people in the University who has used different workfl= ow languages, I myself convinced that introducing an another workflow langu= age is not what actually they need. By changing exiting workflow language t= o another will not solve problems. What they asking is a easy way to constr= uct the workflows. Indirectly what they asking for a sort of API which they= can use to generate the workflows and run it. Correct me if i am wrong her= e.

As most of above repli= es depict, =C2=A0if we can get a simple API, as an example, for a web based= application, JavaScript API would be a good solution, and probably JSON wo= uld be a good candidate for language, instead of XML.

Airavata community already have started to imp= lement web base GUI. Hence introducing a JSON base JavaScript API would be = great help. WDYT?=C2=A0

T= hanks,=C2=A0
Shameera.


On Fri, Sep 19, 2014 at 5:0= 1 PM, Aleksander Slominski (NY) <alekny7@gmail.com> wrote:
Hi,

it= is not dataflow instead focused on orchestrating REST services but you may= find it useful datapoint - we created worfklow service that uses natively = JavaScript and JSON to describe what happens during workflow execution:=C2= =A0https://www.ng.bluemix.net/docs/#services/wo= rkflow/index.html#coewf002

HTH,

= Alek

On Thu, Sep 18, 2014 at 1:54 PM, Suresh Marru &l= t;smarru@apache.org<= /a>> wrote:
Hi Chris,

Great to hear OODT community will be interested in adopting a JSON based wo= rkflow language and potentially a web based composer as well. Airavata prev= iously had BPEL support initially through a home grown implementation [1] b= y Alek Slominski and later through Apache ODE [2]. Also a white paper [3] b= y Alek on this topic is an interesting read.

I am of the same opinion that we should adopt something more modern as the = challenges from scientific workflows seems to be converging with the data f= low patterns in business workflows.

It will be great if we can all compile a list of potential candidates and h= ack them through.

Suresh
[1] -
http://link.springer.com/chapter/10.1007%2F= 978-1-84628-757-2_14#page-1
[2] - http://www.acade= mia.edu/1485773/Experience_with_adapting_a_WS-BPEL_runtime_for_eScience_wor= kflows
[3] - http://www.computer.org/csdl/proceedin= gs/services/2010/4129/00/4129a326.pdf


On Sep 18, 2014, at 1:15 PM, Mattmann, Chris A (3980) <chris.a.mattmann@jpl.nasa= .gov> wrote:

> Hi Guys,
>
> I've been interested in this too - we don't per have a specifi= c
> OODT workflow language, but we specific workflows using XML, and
> other configuration (we are also thinking of moving to JSON for
> this).
>
> In the past I've also looked at YAWL and BPEL - both seem complex<= br> > to me.
>
> I wonder at the end of the day if we should adopt something more
> modern like PIG or some other data flow type of language (PIG
> is really neat).
>
> Cheers,
> Chris
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398)
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email: = chris.a.mattmann@nasa.gov
> WWW:=C2=A0 http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Associate Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
>
> -----Original Message-----
> From: Shameera Rathnayaka <shameerainfo@gmail.com>
> Reply-To: "architecture@airavata.apache.org"
> <architecture@airavata.apache.org>
> Date: Thursday, September 18, 2014 8:26 AM
> To: "architecture@airavata.apache.org" <architecture@airavata= .apache.org>,
> dev <d= ev@airavata.apache.org>
> Subject: Evaluate Suitable Scientific Workflow Language for Airavata.<= br> >
>> Hi All,
>>
>> As we all know Airavata has its own workflow language call XWF. Wh= en XWF
>> was introduced, main focus points are interoperability and convert= ibility.
>> But with years of experience it is convinced that above requiremen= ts are
>> not really useful when we come to real world use cases. And XWF is= XML
>> based bulky language where we attache WSDLs and Workflow image it = self.
>> But
>> with the recent changes WSDL part is being removed from XWF.
>>
>> It is worth to evaluate handy Scientific workflow languages in ind= ustry
>> and
>> find out pros and cons, at the end of this evaluation we need to c= ome up
>> with idea how we should improve Airavata workflow language, either= we can
>> improve existing XWF language, totally change to a new language av= ailable
>> in industry or write a new light weight language. Basic requiremen= ts that
>> we expect from new improvement are, high usability, flexible, ligh= t weight
>> and real time monitoring support. As you can see above requirement= s are
>> not
>> direct comes with workflow languages but we need workflow language= which
>> help to support above requirements.
>>
>> After reading few papers and googling, initially i have come up wi= th
>> following three existing languages,
>> 1. YAWL <http://www.yawlfoundation.org/>
>> 2. WS-BPEL
>> =E2=80=8B3. SIDL
>> <http://computation.llnl.gov/casc/compone= nts/index.html#page=3Dhome>
>>
>> In my opinion SIDL is more familiar with scientific domain, Radica= l-SAGA
>> also uses slightly modified version of SIDL. Other than above thre= e
>> languages we can come up with simple workflow language base on jso= n(or
>> yaml) which support all our requirements for some extends.
>>
>> It would be grate if I can get more input regarding the $Subject f= orm the
>> airavata community. You all are more than welcome to provide any t= ype of
>> suggestions.
>>
>> Thanks,
>> Shameera.
>>
>> =E2=80=8B
>>
>> --
>> Best Regards,
>> Shameera Rathnayaka.
>>
>> email: shameera AT apache.org , shameerainfo AT gmail.com
>> Blog : http://shameerarathnayaka.blogspot.com/




--
The best way to predict the fut= ure is to invent it - Alan Kay



--
Best Regards= ,
Shameera= Rathnayaka.

email: shameera AT apache.org , shameerainfo AT gmail.com
Blog : http://shameerarat= hnayaka.blogspot.com/



<= /div>--
Supun Kamburugam= uva
Member, Apache Software Foundation; http://www.apache.org
E-mail: supun06@gmail.com; =C2=A0Mobile: <= a href=3D"tel:%2B1%20812%20369%206762" value=3D"+18123696762" target=3D"_bl= ank">+1 812 369 6762
Blog: http://supunk.blogspot.com




--
Best Regards= ,
Shameera= Rathnayaka.

email: shameera AT apache.org , shameerainfo AT gmail.com
Blog : http://shameerarat= hnayaka.blogspot.com/
--047d7b3a87b8996c7f0505920659--