airavata-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From K Yoshimoto <kenn...@sdsc.edu>
Subject job description in experiment creation?
Date Wed, 21 Jan 2015 19:06:26 GMT

I was able to launch the example experiment and get output
from the Xbaya quickstart:

https://cwiki.apache.org/confluence/display/AIRAVATA/XBAYA+Quick-Start+Tutorial

I am trying to create and launch my own custom experiment with
the Airavata-remote python client.  However, I'm getting this error
on the server side:

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION'  cannot
accept a NULL value. {prepstmnt 1346602387
INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
        CREATION_TIME, JOB_DESCRIPTION)
    VALUES (?, ?, ?, ?, ?)
[params=(String) IDontNeedaNode_153cb823-1b52-400f-b458-c619fd69c9a6, (String) IDontNeedaNode_153cb823-1b52-400f-b458-c619fd69c9a6,
(null) null, (Timestamp) 2015-01-21 10:16:28.985, (null) null]} [code=-1, state=23502]


Where does JOB_DESCRIPTION get input into the experiment?

Kenneth

On Fri, Jan 16, 2015 at 02:46:20PM -0800, K Yoshimoto wrote:
> 
>  Is there a difference in the experiments that get created
> through xbaya workflow creation and through commandline
> createExperiment?  I can clone and run the xbaya experiment
> through the Python API client, but when I try creating my own
> experiment, the run fails.  Perhaps someone can send out
> the attributes required by createExperiment for creating a runnable
> experiment on localhost?
> 
> Kenneth
> 
> On Fri, Jan 09, 2015 at 03:26:39PM -0800, K Yoshimoto wrote:
> > 
> > Marlon,
> > 
> >  I'm finding all the structures I'm trying to use.  Do the other
> > thrift files get pulled in with the include lines?
> > 
> >  I got to the point of trying to launch an experiment but ran into
> > an error.  Maybe I'm missing a field in my experiment?  Does anyone
> > have a blow-by-blow set of steps for creating a project, creating
> > an experiment, launching the experiment?
> > 
> > ./Airavata-remote -h localhost:8930 getAllUserExperiments kenneth1
> > [ Experiment(userName='kenneth1', experimentOutputs=[], errors=None, applicationVersion=None,
name='dateexperiment', workflowTemplateId=None, projectID='test1_cfe50d5c-6d70-4119-a485-f879943ecfea',
stateChangeList=[WorkflowNodeStatus(timeOfStateChange=1420844997906, workflowNodeState=7)],
creationTime=1420844856258, workflowNodeDetailsList=[WorkflowNodeDetails(nodeInstanceId='IDontNeedaNode_ff3cbbb8-e752-4be6-916d-b3a0fc252826',
errors=[], nodeName='IDontNeedaNode', nodeOutputs=[], executionUnitData=None, workflowNodeStatus=WorkflowNodeStatus(timeOfStateChange=1420844997906,
workflowNodeState=7), creationTime=1420844997871, executionUnit=1, taskDetailsList=[TaskDetails(applicationInputs=[],
errors=[], applicationVersion=None, applicationOutputs=[], applicationDeploymentId=None, advancedOutputDataHandling=None,
creationTime=None, dataTransferDetailsList=[], taskStatus=TaskStatus(timeOfStateChange=1420844997950,
executionState=12), advancedInputDataHandling=None, taskID='IDontNeedaNode_7b028bba-52b7-402a-b9d2-41b43796d675',
jobDetailsList=[], taskScheduling=None, applicationId='datetest_7292e719-beea-4872-b6a2-b6b76c28f3ee')],
nodeInputs=[])], experimentID='dateexperiment_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0', workflowTemplateVersion=None,
workflowExecutionInstanceId=None, userConfigurationData=None, experimentInputs=[], experimentStatus=ExperimentStatus(timeOfStateChange=1420844856279,
experimentState=0), applicationId='datetest_7292e719-beea-4872-b6a2-b6b76c28f3ee', description=None)]
> > 
> > ./Airavata-remote -h localhost:8930 launchExperiment dateexperiment_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0
runme
> > Traceback (most recent call last):
> >   File "./Airavata-remote", line 301, in <module>
> >     pp.pprint(client.launchExperiment(args[0],args[1],))
> >   File "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api/Airavata.py",
line 2572, in launchExperiment
> >     self.recv_launchExperiment()
> >   File "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api/Airavata.py",
line 2589, in recv_launchExperiment
> >     raise x
> > thrift.Thrift.TApplicationException: Internal error processing launchExperiment
> > 
> > 
> > From the server console:
> > 
> > [ERROR] Error occurred during processing of message.
> > java.lang.NullPointerException
> >         at org.apache.airavata.orchestrator.core.validator.impl.SimpleAppDataValidator.validate(SimpleAppDataValidator.java:50)
> >         at org.apache.airavata.orchestrator.cpi.impl.SimpleOrchestratorImpl.validateExperiment(SimpleOrchestratorImpl.java:120)
> >         at org.apache.airavata.orchestrator.server.OrchestratorServerHandler.validateExperiment(OrchestratorServerHandler.java:252)
> >         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Processor$validateExperiment.getResult(OrchestratorService.java:552)
> >         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Processor$validateExperiment.getResult(OrchestratorService.java:536)
> >         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> >         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> >         at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
> >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >         at java.lang.Thread.run(Thread.java:701)
> > [ERROR] Internal error processing launchExperiment
> > org.apache.thrift.transport.TTransportException
> >         at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> >         at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> >         at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:362)

> >         at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:284)

> >         at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:191)
> >         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
> >         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Client.recv_validateExperiment(OrchestratorService.java:239)
> >         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Client.validateExperiment(OrchestratorService.java:226)
> >         at org.apache.airavata.api.server.handler.AiravataServerHandler.launchExperiment(AiravataServerHandler.java:1118)
> >         at org.apache.airavata.api.Airavata$Processor$launchExperiment.getResult(Airavata.java:8929)
> >         at org.apache.airavata.api.Airavata$Processor$launchExperiment.getResult(Airavata.java:8913)
> >         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> >         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> >         at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
> >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >         at java.lang.Thread.run(Thread.java:701)
> > 
> > 
> > On Fri, Jan 09, 2015 at 04:48:09PM -0500, Marlon Pierce wrote:
> > > Hi Kenneth--
> > > 
> > > You'll probably run into problems with the python bindings, but it is an 
> > > easy fix (I think).  The thrift files need to specify the language 
> > > bindings you want. Only three of the thrift files have python bindings 
> > > set up.
> > > 
> > > Marlon
> > > 
> > > 
> > > thrift-interface-descriptions mpierce$ find . -type f -exec grep -il 
> > > "namespace py" {} \;
> > > ./airavataAPI.thrift
> > > ./airavataErrors.thrift
> > > ./workflowAPI.thrift
> > > 
> > > 
> > > On 1/9/15 4:15 PM, K Yoshimoto wrote:
> > > >Okay, looks like the C in Compute needs to be capitalized.
> > > >I must have typoed that.
> > > >
> > > >On Fri, Jan 09, 2015 at 11:46:32AM -0800, K Yoshimoto wrote:
> > > >>Marlon,
> > > >>
> > > >>  I can do the startup with ./airavata-server.sh for now.
> > > >>
> > > >>  I'm trying to go through the steps of creating my own app and
> > > >>launching it using the Python client.  I ran into a problem with
> > > >>a method not found in the client:
> > > >>
> > > >>In 
> > > >>airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api
> > > >>
> > > >>./Airavata-remote -h localhost:8930 getAllcomputeResourceNames
> > > >>Unrecognized method getAllcomputeResourceNames
> > > >>
> > > >>  Should the python client be up-to-date?
> > > >>
> > > >>Kenneth
> > > >>
> > > >>On Thu, Jan 08, 2015 at 08:08:58PM -0500, Marlon Pierce wrote:
> > > >>>Hi Ken--
> > > >>>
> > > >>>Thanks--feel free to fix the startup script and submit a patch.
> > > >>>
> > > >>>Marlon
> > > >>>
> > > >>>On 1/8/15 6:28 PM, K Yoshimoto wrote:
> > > >>>>I grabbed the source release from
> > > >>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
> > > >>>>
> > > >>>>and built that.  The server startup script is still broken
for
> > > >>>>Ubuntu when run as the quick start describes (sh airavata-server.sh),
> > > >>>>but works when invoked as ./airavata-server.sh.
> > > >>>>
> > > >>>>Registering sample apps and xbaya workflow construction work.
> > > >>>>Not sure when the xbaya workflow construction would be useful?
> > > >>>>Running the workflow generates output in /tmp.
> > > >>>>
> > > >>>>I would like to try creating new experiments and running them.
> > > >>>>I will be playing with the python client.  Are all the samples
in
> > > >>>>airavata-0.14/airavata-api/airavata-client-sdks/java-client-samples/src/main/java/org/apache/airavata/client/samples
> > > >>>>
> > > >>>>up-to-date?  I'll probably go by them to try registering new
experiments
> > > >>>>and running them with the python client, unless anyone has
documentation
> > > >>>>handy.
> > > >>>>
> > > >>>>Kenneth
> > > >>>>
> > > >>>>On Wed, Jan 07, 2015 at 12:56:00PM -0500, Marlon Pierce wrote:
> > > >>>>>We also run the server components (not XBaya) full time
and run daily
> > > >>>>>tests against it as part of test-drive.airavata.org.
> > > >>>>>
> > > >>>>>Marlon
> > > >>>>>
> > > >>>>>On 1/7/15 12:31 PM, K Yoshimoto wrote:
> > > >>>>>>Was it stable enough to use outside the demo?  Any
problems to note?
> > > >>>>>>
> > > >>>>>>On Wed, Jan 07, 2015 at 10:48:58PM +0530, Suresh Marru
wrote:
> > > >>>>>>>+ 1 for the release.
> > > >>>>>>>
> > > >>>>>>>P.S. I was able to demo this RC2 in a talk and
couple of participants
> > > >>>>>>>followed along successfully.
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>>On Dec 30, 2014, at 1:34 AM, Chathuri Wimalasena

> > > >>>>>>><kamalasini@gmail.com>
> > > >>>>>>>wrote:
> > > >>>>>>>
> > > >>>>>>>>Apache Airavata PMC is pleased to call for
a vote on the following
> > > >>>>>>>>Apache Airavata 0.14 release candidate artifacts:
> > > >>>>>>>>
> > > >>>>>>>>Detailed change log/release notes:
> > > >>>>>>>>
> > > >>>>>>>>https://git-wip-us.apache.org/repos/asf?p=airavata.git;a=blob_plain;f=RELEASE_NOTES;hb=refs/tags/airavata-0.14
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>All Release Artifacts:
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>PGP release keys (signed using 65541DBC):
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/release/airavata/KEYS
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>Specific URL's:
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>GIT source tag:
> > > >>>>>>>>https://git-wip-us.apache.org/repos/asf?p=airavata.git;a=shortlog;h=refs/tags/airavata-0.14
> > > >>>>>>>>
> > > >>>>>>>>Source release:
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/airavata-0.14-source-release.zip
> > > >>>>>>>>
> > > >>>>>>>>Binary Artifacts:
> > > >>>>>>>>
> > > >>>>>>>>Airavata Server:
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-server-0.14-bin.zip
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-server-0.14-bin.tar.gz
> > > >>>>>>>>
> > > >>>>>>>>API Server
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-api-server-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-api-server-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>GFac Server
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-gfac-server-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-gfac-server-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>Orchestrator Server
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-orchestrator-server-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-orchestrator-server-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>Xbaya Distribution
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-xbaya-gui-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-xbaya-gui-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>Client SDKs
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-java-sdk-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-java-sdk-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-php-sdk-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-php-sdk-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>Maven staging repo:
> > > >>>>>>>>https://repository.apache.org/content/repositories/orgapacheairavata-1005
> > > >>>>>>>>
> > > >>>>>>>>Please verify the artifacts and vote. The vote
will be open for 
> > > >>>>>>>>atleast
> > > >>>>>>>>72 hours.
> > > >>>>>>>>
> > > >>>>>>>>[ ] +1  approve
> > > >>>>>>>>[ ] +0  no opinion
> > > >>>>>>>>[ ] -1  disapprove (and reason why)
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>[ ] +1  approve
> > > >>>>>>>>[ ] +0  no opinion
> > > >>>>>>>>[ ] -1  disapprove (and reason why)
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>

Mime
View raw message