airavata-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raminder Singh <raminderjsi...@gmail.com>
Subject Re: job description in experiment creation?
Date Fri, 23 Jan 2015 14:57:55 GMT
Hi Kenneth,

In case you are running jobs on local machine (localprovider) then the job description is
filled from Application catalog > Application deployment description but incase of remote
(SSH or GSISSH) its filled based on Job scheduler (PBS,SLURM) parameters. You can look in
the provider codes(LocalProvider, GSISSHProvider) in GFAC for more details.  Please share
the stacktrace so i can find more details.  According to my understanding error should not
be different for Xbaya or Python client. Share more information and i will debug to provide
you more information.

Thanks
Raminder
 
On Jan 21, 2015, at 2:06 PM, K Yoshimoto <kenneth@sdsc.edu> wrote:

> 
> I was able to launch the example experiment and get output
> from the Xbaya quickstart:
> 
> https://cwiki.apache.org/confluence/display/AIRAVATA/XBAYA+Quick-Start+Tutorial
> 
> I am trying to create and launch my own custom experiment with
> the Airavata-remote python client.  However, I'm getting this error
> on the server side:
> 
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION'
 cannot accept a NULL value. {prepstmnt 1346602387
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>        CREATION_TIME, JOB_DESCRIPTION)
>    VALUES (?, ?, ?, ?, ?)
> [params=(String) IDontNeedaNode_153cb823-1b52-400f-b458-c619fd69c9a6, (String) IDontNeedaNode_153cb823-1b52-400f-b458-c619fd69c9a6,
(null) null, (Timestamp) 2015-01-21 10:16:28.985, (null) null]} [code=-1, state=23502]
> 
> 
> Where does JOB_DESCRIPTION get input into the experiment?
> 
> Kenneth
> 
> On Fri, Jan 16, 2015 at 02:46:20PM -0800, K Yoshimoto wrote:
>> 
>> Is there a difference in the experiments that get created
>> through xbaya workflow creation and through commandline
>> createExperiment?  I can clone and run the xbaya experiment
>> through the Python API client, but when I try creating my own
>> experiment, the run fails.  Perhaps someone can send out
>> the attributes required by createExperiment for creating a runnable
>> experiment on localhost?
>> 
>> Kenneth
>> 
>> On Fri, Jan 09, 2015 at 03:26:39PM -0800, K Yoshimoto wrote:
>>> 
>>> Marlon,
>>> 
>>> I'm finding all the structures I'm trying to use.  Do the other
>>> thrift files get pulled in with the include lines?
>>> 
>>> I got to the point of trying to launch an experiment but ran into
>>> an error.  Maybe I'm missing a field in my experiment?  Does anyone
>>> have a blow-by-blow set of steps for creating a project, creating
>>> an experiment, launching the experiment?
>>> 
>>> ./Airavata-remote -h localhost:8930 getAllUserExperiments kenneth1
>>> [ Experiment(userName='kenneth1', experimentOutputs=[], errors=None, applicationVersion=None,
name='dateexperiment', workflowTemplateId=None, projectID='test1_cfe50d5c-6d70-4119-a485-f879943ecfea',
stateChangeList=[WorkflowNodeStatus(timeOfStateChange=1420844997906, workflowNodeState=7)],
creationTime=1420844856258, workflowNodeDetailsList=[WorkflowNodeDetails(nodeInstanceId='IDontNeedaNode_ff3cbbb8-e752-4be6-916d-b3a0fc252826',
errors=[], nodeName='IDontNeedaNode', nodeOutputs=[], executionUnitData=None, workflowNodeStatus=WorkflowNodeStatus(timeOfStateChange=1420844997906,
workflowNodeState=7), creationTime=1420844997871, executionUnit=1, taskDetailsList=[TaskDetails(applicationInputs=[],
errors=[], applicationVersion=None, applicationOutputs=[], applicationDeploymentId=None, advancedOutputDataHandling=None,
creationTime=None, dataTransferDetailsList=[], taskStatus=TaskStatus(timeOfStateChange=1420844997950,
executionState=12), advancedInputDataHandling=None, taskID='IDontNeedaNode_7b028bba-52b7-402a-b9d2-41b43796d675',
jobDetailsList=[], taskScheduling=None, applicationId='datetest_7292e719-beea-4872-b6a2-b6b76c28f3ee')],
nodeInputs=[])], experimentID='dateexperiment_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0', workflowTemplateVersion=None,
workflowExecutionInstanceId=None, userConfigurationData=None, experimentInputs=[], experimentStatus=ExperimentStatus(timeOfStateChange=1420844856279,
experimentState=0), applicationId='datetest_7292e719-beea-4872-b6a2-b6b76c28f3ee', description=None)]
>>> 
>>> ./Airavata-remote -h localhost:8930 launchExperiment dateexperiment_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0
runme
>>> Traceback (most recent call last):
>>>  File "./Airavata-remote", line 301, in <module>
>>>    pp.pprint(client.launchExperiment(args[0],args[1],))
>>>  File "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api/Airavata.py",
line 2572, in launchExperiment
>>>    self.recv_launchExperiment()
>>>  File "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api/Airavata.py",
line 2589, in recv_launchExperiment
>>>    raise x
>>> thrift.Thrift.TApplicationException: Internal error processing launchExperiment
>>> 
>>> 
>>> From the server console:
>>> 
>>> [ERROR] Error occurred during processing of message.
>>> java.lang.NullPointerException
>>>        at org.apache.airavata.orchestrator.core.validator.impl.SimpleAppDataValidator.validate(SimpleAppDataValidator.java:50)
>>>        at org.apache.airavata.orchestrator.cpi.impl.SimpleOrchestratorImpl.validateExperiment(SimpleOrchestratorImpl.java:120)
>>>        at org.apache.airavata.orchestrator.server.OrchestratorServerHandler.validateExperiment(OrchestratorServerHandler.java:252)
>>>        at org.apache.airavata.orchestrator.cpi.OrchestratorService$Processor$validateExperiment.getResult(OrchestratorService.java:552)
>>>        at org.apache.airavata.orchestrator.cpi.OrchestratorService$Processor$validateExperiment.getResult(OrchestratorService.java:536)
>>>        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
>>>        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>>>        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
>>>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>        at java.lang.Thread.run(Thread.java:701)
>>> [ERROR] Internal error processing launchExperiment
>>> org.apache.thrift.transport.TTransportException
>>>        at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
>>>        at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
>>>        at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:362)

>>>        at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:284)

>>>        at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:191)
>>>        at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
>>>        at org.apache.airavata.orchestrator.cpi.OrchestratorService$Client.recv_validateExperiment(OrchestratorService.java:239)
>>>        at org.apache.airavata.orchestrator.cpi.OrchestratorService$Client.validateExperiment(OrchestratorService.java:226)
>>>        at org.apache.airavata.api.server.handler.AiravataServerHandler.launchExperiment(AiravataServerHandler.java:1118)
>>>        at org.apache.airavata.api.Airavata$Processor$launchExperiment.getResult(Airavata.java:8929)
>>>        at org.apache.airavata.api.Airavata$Processor$launchExperiment.getResult(Airavata.java:8913)
>>>        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
>>>        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>>>        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
>>>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>        at java.lang.Thread.run(Thread.java:701)
>>> 
>>> 
>>> On Fri, Jan 09, 2015 at 04:48:09PM -0500, Marlon Pierce wrote:
>>>> Hi Kenneth--
>>>> 
>>>> You'll probably run into problems with the python bindings, but it is an

>>>> easy fix (I think).  The thrift files need to specify the language 
>>>> bindings you want. Only three of the thrift files have python bindings 
>>>> set up.
>>>> 
>>>> Marlon
>>>> 
>>>> 
>>>> thrift-interface-descriptions mpierce$ find . -type f -exec grep -il 
>>>> "namespace py" {} \;
>>>> ./airavataAPI.thrift
>>>> ./airavataErrors.thrift
>>>> ./workflowAPI.thrift
>>>> 
>>>> 
>>>> On 1/9/15 4:15 PM, K Yoshimoto wrote:
>>>>> Okay, looks like the C in Compute needs to be capitalized.
>>>>> I must have typoed that.
>>>>> 
>>>>> On Fri, Jan 09, 2015 at 11:46:32AM -0800, K Yoshimoto wrote:
>>>>>> Marlon,
>>>>>> 
>>>>>> I can do the startup with ./airavata-server.sh for now.
>>>>>> 
>>>>>> I'm trying to go through the steps of creating my own app and
>>>>>> launching it using the Python client.  I ran into a problem with
>>>>>> a method not found in the client:
>>>>>> 
>>>>>> In 
>>>>>> airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api
>>>>>> 
>>>>>> ./Airavata-remote -h localhost:8930 getAllcomputeResourceNames
>>>>>> Unrecognized method getAllcomputeResourceNames
>>>>>> 
>>>>>> Should the python client be up-to-date?
>>>>>> 
>>>>>> Kenneth
>>>>>> 
>>>>>> On Thu, Jan 08, 2015 at 08:08:58PM -0500, Marlon Pierce wrote:
>>>>>>> Hi Ken--
>>>>>>> 
>>>>>>> Thanks--feel free to fix the startup script and submit a patch.
>>>>>>> 
>>>>>>> Marlon
>>>>>>> 
>>>>>>> On 1/8/15 6:28 PM, K Yoshimoto wrote:
>>>>>>>> I grabbed the source release from
>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
>>>>>>>> 
>>>>>>>> and built that.  The server startup script is still broken
for
>>>>>>>> Ubuntu when run as the quick start describes (sh airavata-server.sh),
>>>>>>>> but works when invoked as ./airavata-server.sh.
>>>>>>>> 
>>>>>>>> Registering sample apps and xbaya workflow construction work.
>>>>>>>> Not sure when the xbaya workflow construction would be useful?
>>>>>>>> Running the workflow generates output in /tmp.
>>>>>>>> 
>>>>>>>> I would like to try creating new experiments and running
them.
>>>>>>>> I will be playing with the python client.  Are all the samples
in
>>>>>>>> airavata-0.14/airavata-api/airavata-client-sdks/java-client-samples/src/main/java/org/apache/airavata/client/samples
>>>>>>>> 
>>>>>>>> up-to-date?  I'll probably go by them to try registering
new experiments
>>>>>>>> and running them with the python client, unless anyone has
documentation
>>>>>>>> handy.
>>>>>>>> 
>>>>>>>> Kenneth
>>>>>>>> 
>>>>>>>> On Wed, Jan 07, 2015 at 12:56:00PM -0500, Marlon Pierce wrote:
>>>>>>>>> We also run the server components (not XBaya) full time
and run daily
>>>>>>>>> tests against it as part of test-drive.airavata.org.
>>>>>>>>> 
>>>>>>>>> Marlon
>>>>>>>>> 
>>>>>>>>> On 1/7/15 12:31 PM, K Yoshimoto wrote:
>>>>>>>>>> Was it stable enough to use outside the demo?  Any
problems to note?
>>>>>>>>>> 
>>>>>>>>>> On Wed, Jan 07, 2015 at 10:48:58PM +0530, Suresh
Marru wrote:
>>>>>>>>>>> + 1 for the release.
>>>>>>>>>>> 
>>>>>>>>>>> P.S. I was able to demo this RC2 in a talk and
couple of participants
>>>>>>>>>>> followed along successfully.
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>>> On Dec 30, 2014, at 1:34 AM, Chathuri Wimalasena

>>>>>>>>>>> <kamalasini@gmail.com>
>>>>>>>>>>> wrote:
>>>>>>>>>>> 
>>>>>>>>>>>> Apache Airavata PMC is pleased to call for
a vote on the following
>>>>>>>>>>>> Apache Airavata 0.14 release candidate artifacts:
>>>>>>>>>>>> 
>>>>>>>>>>>> Detailed change log/release notes:
>>>>>>>>>>>> 
>>>>>>>>>>>> https://git-wip-us.apache.org/repos/asf?p=airavata.git;a=blob_plain;f=RELEASE_NOTES;hb=refs/tags/airavata-0.14
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> All Release Artifacts:
>>>>>>>>>>>> 
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> PGP release keys (signed using 65541DBC):
>>>>>>>>>>>> 
>>>>>>>>>>>> https://dist.apache.org/repos/dist/release/airavata/KEYS
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> Specific URL's:
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> GIT source tag:
>>>>>>>>>>>> https://git-wip-us.apache.org/repos/asf?p=airavata.git;a=shortlog;h=refs/tags/airavata-0.14
>>>>>>>>>>>> 
>>>>>>>>>>>> Source release:
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/airavata-0.14-source-release.zip
>>>>>>>>>>>> 
>>>>>>>>>>>> Binary Artifacts:
>>>>>>>>>>>> 
>>>>>>>>>>>> Airavata Server:
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-server-0.14-bin.zip
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-server-0.14-bin.tar.gz
>>>>>>>>>>>> 
>>>>>>>>>>>> API Server
>>>>>>>>>>>> 
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-api-server-0.14-bin.tar.gz
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-api-server-0.14-bin.zip
>>>>>>>>>>>> 
>>>>>>>>>>>> GFac Server
>>>>>>>>>>>> 
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-gfac-server-0.14-bin.tar.gz
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-gfac-server-0.14-bin.zip
>>>>>>>>>>>> 
>>>>>>>>>>>> Orchestrator Server
>>>>>>>>>>>> 
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-orchestrator-server-0.14-bin.tar.gz
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-orchestrator-server-0.14-bin.zip
>>>>>>>>>>>> 
>>>>>>>>>>>> Xbaya Distribution
>>>>>>>>>>>> 
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-xbaya-gui-0.14-bin.tar.gz
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-xbaya-gui-0.14-bin.zip
>>>>>>>>>>>> 
>>>>>>>>>>>> Client SDKs
>>>>>>>>>>>> 
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-java-sdk-0.14-bin.tar.gz
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-java-sdk-0.14-bin.zip
>>>>>>>>>>>> 
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-php-sdk-0.14-bin.tar.gz
>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-php-sdk-0.14-bin.zip
>>>>>>>>>>>> 
>>>>>>>>>>>> Maven staging repo:
>>>>>>>>>>>> https://repository.apache.org/content/repositories/orgapacheairavata-1005
>>>>>>>>>>>> 
>>>>>>>>>>>> Please verify the artifacts and vote. The
vote will be open for 
>>>>>>>>>>>> atleast
>>>>>>>>>>>> 72 hours.
>>>>>>>>>>>> 
>>>>>>>>>>>> [ ] +1  approve
>>>>>>>>>>>> [ ] +0  no opinion
>>>>>>>>>>>> [ ] -1  disapprove (and reason why)
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> [ ] +1  approve
>>>>>>>>>>>> [ ] +0  no opinion
>>>>>>>>>>>> [ ] -1  disapprove (and reason why)
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> 


Mime
View raw message