airavata-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pankaj Saha <psa...@binghamton.edu>
Subject Re: Airavata installation to submit a job in Mesos/Maraton cluster
Date Sat, 05 Dec 2015 23:43:13 GMT
HI Suresh,
Yes Now airavata can not submit mesos jobs directl. Here is the plan I was
trying to implement.
my local system has Marathon client installed which is connected to Mesos a
cluster. If I can configure my system as an available computer resource in
the Airavata PGA then I can start an experiment on this. Now that
experiment will run on my local computer which eventually launch a marathon
job through a command with help of marathon rest API.

Do you think that will work?

Thanks
Pankaj



On Sat, Dec 5, 2015 at 3:25 PM, Suresh Marru <smarru@apache.org> wrote:

> Hi Pankaj,
>
> You probably already know this, there is no Mesos submission in Airavata
> out of the box or in the version deployed on GW56?. Did you add that
> implementation in your local version?
>
> Suresh
>
> On Dec 5, 2015, at 2:53 PM, Pankaj Saha <psaha4@binghamton.edu> wrote:
>
> is your mesos cluster registered in the PGA as computer resource.
> - No
> Is the hello world application catalog entries made.
> -No
> Can you do this in a PGA using the gw56 ( I assume you have admin
> privileges).
> - I dont see any option for creating that. But I remember during GSoC,
> Erom explained those PGA pages through which admin can do this.
>
> On Sat, Dec 5, 2015 at 2:49 PM, Pamidighantam, Sudhakar V <
> spamidig@illinois.edu> wrote:
>
>> Pankaj;
>> is your mesos cluster registered in the PGA as computer resource. Is the
>> hello world application catalog entries made. Can you do this in a PGA
>> using the gw56 ( I assume you have admin privileges). If not somebody can
>> do this for you.
>>
>> Thanks,
>> Sudhakar.
>>
>> On Dec 5, 2015, at 1:26 PM, Pankaj Saha <psaha4@binghamton.edu> wrote:
>>
>> Hi Supun,
>> I have pointed to 'airavata-server' => 'gw56.iu.xsede.org
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__gw56.iu.xsede.org&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=ASTU-C5xu6y1xk5S0FSk2K1D1Uo4h9YYJkRuKxzci9M&s=hITQ1gHzjSu908vXK8qWqRZbVFsw48Ecf5vWuKd3jKc&e=>',
>> to start working with.As you have already provided all the required
>> previleges to my new userid, I am able to see all computer resources and
>> applications in it. So it was not a problem with PGA but Airavata server
>> installation in my local machine.
>>
>> Now can anyone please guide me for launching a hello world application
>> through this portal so that it can launch a job in a mesos cluster. I know
>> that I can not use the "gw56.iu.xsede.org
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__gw56.iu.xsede.org&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=ASTU-C5xu6y1xk5S0FSk2K1D1Uo4h9YYJkRuKxzci9M&s=hITQ1gHzjSu908vXK8qWqRZbVFsw48Ecf5vWuKd3jKc&e=>"
>> server, as I want to launch a job in my local mesos/marathon cluster. But
>> if I get some clue how to start with I can possible fix my local Airavata
>> server installation and will try to launch a job in local resource.
>>
>> Thanks
>> Pankaj
>>
>> On Fri, Dec 4, 2015 at 5:41 PM, Supun Nakandala <
>> supun.nakandala@gmail.com> wrote:
>>
>>> We haven't done any changes to 0.15 branches recently. So if it worked
>>> for you previously it should still work without any issue. I suggest that
>>> you first try to setup your pga to work with SciGaP hosted airavata and
>>> then try to connect it to your own airavata. But we don't have any active
>>> deployments of 0.15. In that case you may want to use master branch
>>>
>>> On Fri, Dec 4, 2015 at 5:36 PM, Pankaj Saha <psaha4@binghamton.edu>
>>> wrote:
>>>
>>>> While running server, no error messages. But while creating projects
>>>> its throws the error message which I have posted.
>>>> On 04-Dec-2015 4:55 PM, "Supun Nakandala" <supun.nakandala@gmail.com>
>>>> wrote:
>>>>
>>>>> do you get any airavata error messages?
>>>>>
>>>>> On Fri, Dec 4, 2015 at 4:51 PM, Pankaj Saha <psaha4@binghamton.edu>
>>>>> wrote:
>>>>>
>>>>>> I am using 15 branch
>>>>>> yes I could not even create a project.
>>>>>>
>>>>>> On Fri, Dec 4, 2015 at 4:49 PM, Supun Nakandala <
>>>>>> supun.nakandala@gmail.com> wrote:
>>>>>>
>>>>>>> Which Airavata/PGA version are you using?
>>>>>>>
>>>>>>> Looking at your error message I see even the project is also
not set.
>>>>>>>
>>>>>>> On Fri, Dec 4, 2015 at 12:16 PM, Pankaj Saha <psaha4@binghamton.edu>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hello Devs,
>>>>>>>> I have a requirement to launch a job (simple hello world
kind of)
>>>>>>>> on mesos/marathon cluster through Airavata client (PGA preferable
). I have
>>>>>>>> tried installing a local Aiaravata PGA with hosted Airavata
server on my
>>>>>>>> machine. Now the problem is with PGA installation, its not
allowing me
>>>>>>>> create or explore any project/experiment.
>>>>>>>> Its saying:
>>>>>>>> *Required field 'gatewayId' was not present! Struct:
>>>>>>>> createProject_args(gatewayId:null, project:null)*
>>>>>>>>
>>>>>>>> I always used the default  gateway-Id which is "default"
and the
>>>>>>>> same is mentioned in the server configuration properties
file too. This
>>>>>>>> problem I have never faced earlier and Airavata installation
used to be
>>>>>>>> very simple.
>>>>>>>>
>>>>>>>> Second challenge is to run a job through Airavata client,
so that
>>>>>>>> it can launch a job in a Mesos cluster through Marathon.
So Airavata should
>>>>>>>> be able to invoke a rest API based client of Marathon to
do the job.
>>>>>>>> I seek help to resolve the first issue and then need to find
a way
>>>>>>>> for launching jobs.
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> Pankaj
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Thank you
>>>>>>> Supun Nakandala
>>>>>>> Dept. Computer Science and Engineering
>>>>>>> University of Moratuwa
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Thank you
>>>>> Supun Nakandala
>>>>> Dept. Computer Science and Engineering
>>>>> University of Moratuwa
>>>>>
>>>>
>>>
>>>
>>> --
>>> Thank you
>>> Supun Nakandala
>>> Dept. Computer Science and Engineering
>>> University of Moratuwa
>>>
>>
>>
>>
>
>

Mime
View raw message