airavata-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pankaj Saha <psa...@binghamton.edu>
Subject Re: Airavata installation to submit a job in Mesos/Maraton cluster
Date Mon, 07 Dec 2015 18:03:40 GMT
Hi Suresh,
I am setting up for 0.16  and will implement the approach. Will update you.

Thanks
Pankaj
On 07-Dec-2015 12:50 PM, "Suresh Marru" <smarru@apache.org> wrote:

> Hi Pankaj,
>
> Yes this should work as you are trying to do. Lets try and get this
> scenario working with 0.16. Can you start updating your PGA and Airavata to
> latest git master, that way its easy to debug with active code base. 0.15
> branch is frozen and if we find any bug, it will be easier to fix in
> master.
>
> Suresh
>
> On Dec 5, 2015, at 6:43 PM, Pankaj Saha <psaha4@binghamton.edu> wrote:
>
> HI Suresh,
> Yes Now airavata can not submit mesos jobs directl. Here is the plan I was
> trying to implement.
> my local system has Marathon client installed which is connected to Mesos
> a cluster. If I can configure my system as an available computer resource
> in the Airavata PGA then I can start an experiment on this. Now that
> experiment will run on my local computer which eventually launch a marathon
> job through a command with help of marathon rest API.
>
> Do you think that will work?
>
> Thanks
> Pankaj
>
>
>
> On Sat, Dec 5, 2015 at 3:25 PM, Suresh Marru <smarru@apache.org> wrote:
>
>> Hi Pankaj,
>>
>> You probably already know this, there is no Mesos submission in Airavata
>> out of the box or in the version deployed on GW56?. Did you add that
>> implementation in your local version?
>>
>> Suresh
>>
>> On Dec 5, 2015, at 2:53 PM, Pankaj Saha <psaha4@binghamton.edu> wrote:
>>
>> is your mesos cluster registered in the PGA as computer resource.
>> - No
>> Is the hello world application catalog entries made.
>> -No
>> Can you do this in a PGA using the gw56 ( I assume you have admin
>> privileges).
>> - I dont see any option for creating that. But I remember during GSoC,
>> Erom explained those PGA pages through which admin can do this.
>>
>> On Sat, Dec 5, 2015 at 2:49 PM, Pamidighantam, Sudhakar V <
>> spamidig@illinois.edu> wrote:
>>
>>> Pankaj;
>>> is your mesos cluster registered in the PGA as computer resource. Is the
>>> hello world application catalog entries made. Can you do this in a PGA
>>> using the gw56 ( I assume you have admin privileges). If not somebody can
>>> do this for you.
>>>
>>> Thanks,
>>> Sudhakar.
>>>
>>> On Dec 5, 2015, at 1:26 PM, Pankaj Saha <psaha4@binghamton.edu> wrote:
>>>
>>> Hi Supun,
>>> I have pointed to 'airavata-server' => 'gw56.iu.xsede.org
>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__gw56.iu.xsede.org&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=ASTU-C5xu6y1xk5S0FSk2K1D1Uo4h9YYJkRuKxzci9M&s=hITQ1gHzjSu908vXK8qWqRZbVFsw48Ecf5vWuKd3jKc&e=>',
>>> to start working with.As you have already provided all the required
>>> previleges to my new userid, I am able to see all computer resources and
>>> applications in it. So it was not a problem with PGA but Airavata server
>>> installation in my local machine.
>>>
>>> Now can anyone please guide me for launching a hello world application
>>> through this portal so that it can launch a job in a mesos cluster. I know
>>> that I can not use the "gw56.iu.xsede.org
>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__gw56.iu.xsede.org&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=ASTU-C5xu6y1xk5S0FSk2K1D1Uo4h9YYJkRuKxzci9M&s=hITQ1gHzjSu908vXK8qWqRZbVFsw48Ecf5vWuKd3jKc&e=>"
>>> server, as I want to launch a job in my local mesos/marathon cluster. But
>>> if I get some clue how to start with I can possible fix my local Airavata
>>> server installation and will try to launch a job in local resource.
>>>
>>> Thanks
>>> Pankaj
>>>
>>> On Fri, Dec 4, 2015 at 5:41 PM, Supun Nakandala <
>>> supun.nakandala@gmail.com> wrote:
>>>
>>>> We haven't done any changes to 0.15 branches recently. So if it worked
>>>> for you previously it should still work without any issue. I suggest that
>>>> you first try to setup your pga to work with SciGaP hosted airavata and
>>>> then try to connect it to your own airavata. But we don't have any active
>>>> deployments of 0.15. In that case you may want to use master branch
>>>>
>>>> On Fri, Dec 4, 2015 at 5:36 PM, Pankaj Saha <psaha4@binghamton.edu>
>>>> wrote:
>>>>
>>>>> While running server, no error messages. But while creating projects
>>>>> its throws the error message which I have posted.
>>>>> On 04-Dec-2015 4:55 PM, "Supun Nakandala" <supun.nakandala@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> do you get any airavata error messages?
>>>>>>
>>>>>> On Fri, Dec 4, 2015 at 4:51 PM, Pankaj Saha <psaha4@binghamton.edu>
>>>>>> wrote:
>>>>>>
>>>>>>> I am using 15 branch
>>>>>>> yes I could not even create a project.
>>>>>>>
>>>>>>> On Fri, Dec 4, 2015 at 4:49 PM, Supun Nakandala <
>>>>>>> supun.nakandala@gmail.com> wrote:
>>>>>>>
>>>>>>>> Which Airavata/PGA version are you using?
>>>>>>>>
>>>>>>>> Looking at your error message I see even the project is also
not
>>>>>>>> set.
>>>>>>>>
>>>>>>>> On Fri, Dec 4, 2015 at 12:16 PM, Pankaj Saha <psaha4@binghamton.edu
>>>>>>>> > wrote:
>>>>>>>>
>>>>>>>>> Hello Devs,
>>>>>>>>> I have a requirement to launch a job (simple hello world
kind of)
>>>>>>>>> on mesos/marathon cluster through Airavata client (PGA
preferable ). I have
>>>>>>>>> tried installing a local Aiaravata PGA with hosted Airavata
server on my
>>>>>>>>> machine. Now the problem is with PGA installation, its
not allowing me
>>>>>>>>> create or explore any project/experiment.
>>>>>>>>> Its saying:
>>>>>>>>> *Required field 'gatewayId' was not present! Struct:
>>>>>>>>> createProject_args(gatewayId:null, project:null)*
>>>>>>>>>
>>>>>>>>> I always used the default  gateway-Id which is "default"
and the
>>>>>>>>> same is mentioned in the server configuration properties
file too. This
>>>>>>>>> problem I have never faced earlier and Airavata installation
used to be
>>>>>>>>> very simple.
>>>>>>>>>
>>>>>>>>> Second challenge is to run a job through Airavata client,
so that
>>>>>>>>> it can launch a job in a Mesos cluster through Marathon.
So Airavata should
>>>>>>>>> be able to invoke a rest API based client of Marathon
to do the job.
>>>>>>>>> I seek help to resolve the first issue and then need
to find a way
>>>>>>>>> for launching jobs.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks
>>>>>>>>> Pankaj
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Thank you
>>>>>>>> Supun Nakandala
>>>>>>>> Dept. Computer Science and Engineering
>>>>>>>> University of Moratuwa
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Thank you
>>>>>> Supun Nakandala
>>>>>> Dept. Computer Science and Engineering
>>>>>> University of Moratuwa
>>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Thank you
>>>> Supun Nakandala
>>>> Dept. Computer Science and Engineering
>>>> University of Moratuwa
>>>>
>>>
>>>
>>>
>>
>>
>
>

Mime
View raw message