airavata-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From K Yoshimoto <kenn...@sdsc.edu>
Subject Re: [VOTE] Apache Airavata release 0.14 - RC2
Date Fri, 16 Jan 2015 22:46:20 GMT

 Is there a difference in the experiments that get created
through xbaya workflow creation and through commandline
createExperiment?  I can clone and run the xbaya experiment
through the Python API client, but when I try creating my own
experiment, the run fails.  Perhaps someone can send out
the attributes required by createExperiment for creating a runnable
experiment on localhost?

Kenneth

On Fri, Jan 09, 2015 at 03:26:39PM -0800, K Yoshimoto wrote:
> 
> Marlon,
> 
>  I'm finding all the structures I'm trying to use.  Do the other
> thrift files get pulled in with the include lines?
> 
>  I got to the point of trying to launch an experiment but ran into
> an error.  Maybe I'm missing a field in my experiment?  Does anyone
> have a blow-by-blow set of steps for creating a project, creating
> an experiment, launching the experiment?
> 
> ./Airavata-remote -h localhost:8930 getAllUserExperiments kenneth1
> [ Experiment(userName='kenneth1', experimentOutputs=[], errors=None, applicationVersion=None,
name='dateexperiment', workflowTemplateId=None, projectID='test1_cfe50d5c-6d70-4119-a485-f879943ecfea',
stateChangeList=[WorkflowNodeStatus(timeOfStateChange=1420844997906, workflowNodeState=7)],
creationTime=1420844856258, workflowNodeDetailsList=[WorkflowNodeDetails(nodeInstanceId='IDontNeedaNode_ff3cbbb8-e752-4be6-916d-b3a0fc252826',
errors=[], nodeName='IDontNeedaNode', nodeOutputs=[], executionUnitData=None, workflowNodeStatus=WorkflowNodeStatus(timeOfStateChange=1420844997906,
workflowNodeState=7), creationTime=1420844997871, executionUnit=1, taskDetailsList=[TaskDetails(applicationInputs=[],
errors=[], applicationVersion=None, applicationOutputs=[], applicationDeploymentId=None, advancedOutputDataHandling=None,
creationTime=None, dataTransferDetailsList=[], taskStatus=TaskStatus(timeOfStateChange=1420844997950,
executionState=12), advancedInputDataHandling=None, taskID='IDontNeedaNode_7b028bba-52b7-402a-b9d2-41b43796d675',
jobDetailsList=[], taskScheduling=None, applicationId='datetest_7292e719-beea-4872-b6a2-b6b76c28f3ee')],
nodeInputs=[])], experimentID='dateexperiment_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0', workflowTemplateVersion=None,
workflowExecutionInstanceId=None, userConfigurationData=None, experimentInputs=[], experimentStatus=ExperimentStatus(timeOfStateChange=1420844856279,
experimentState=0), applicationId='datetest_7292e719-beea-4872-b6a2-b6b76c28f3ee', description=None)]
> 
> ./Airavata-remote -h localhost:8930 launchExperiment dateexperiment_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0
runme
> Traceback (most recent call last):
>   File "./Airavata-remote", line 301, in <module>
>     pp.pprint(client.launchExperiment(args[0],args[1],))
>   File "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api/Airavata.py",
line 2572, in launchExperiment
>     self.recv_launchExperiment()
>   File "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api/Airavata.py",
line 2589, in recv_launchExperiment
>     raise x
> thrift.Thrift.TApplicationException: Internal error processing launchExperiment
> 
> 
> From the server console:
> 
> [ERROR] Error occurred during processing of message.
> java.lang.NullPointerException
>         at org.apache.airavata.orchestrator.core.validator.impl.SimpleAppDataValidator.validate(SimpleAppDataValidator.java:50)
>         at org.apache.airavata.orchestrator.cpi.impl.SimpleOrchestratorImpl.validateExperiment(SimpleOrchestratorImpl.java:120)
>         at org.apache.airavata.orchestrator.server.OrchestratorServerHandler.validateExperiment(OrchestratorServerHandler.java:252)
>         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Processor$validateExperiment.getResult(OrchestratorService.java:552)
>         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Processor$validateExperiment.getResult(OrchestratorService.java:536)
>         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
>         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>         at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:701)
> [ERROR] Internal error processing launchExperiment
> org.apache.thrift.transport.TTransportException
>         at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
>         at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
>         at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:362)

>         at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:284)

>         at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:191)
>         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
>         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Client.recv_validateExperiment(OrchestratorService.java:239)
>         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Client.validateExperiment(OrchestratorService.java:226)
>         at org.apache.airavata.api.server.handler.AiravataServerHandler.launchExperiment(AiravataServerHandler.java:1118)
>         at org.apache.airavata.api.Airavata$Processor$launchExperiment.getResult(Airavata.java:8929)
>         at org.apache.airavata.api.Airavata$Processor$launchExperiment.getResult(Airavata.java:8913)
>         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
>         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>         at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:701)
> 
> 
> On Fri, Jan 09, 2015 at 04:48:09PM -0500, Marlon Pierce wrote:
> > Hi Kenneth--
> > 
> > You'll probably run into problems with the python bindings, but it is an 
> > easy fix (I think).  The thrift files need to specify the language 
> > bindings you want. Only three of the thrift files have python bindings 
> > set up.
> > 
> > Marlon
> > 
> > 
> > thrift-interface-descriptions mpierce$ find . -type f -exec grep -il 
> > "namespace py" {} \;
> > ./airavataAPI.thrift
> > ./airavataErrors.thrift
> > ./workflowAPI.thrift
> > 
> > 
> > On 1/9/15 4:15 PM, K Yoshimoto wrote:
> > >Okay, looks like the C in Compute needs to be capitalized.
> > >I must have typoed that.
> > >
> > >On Fri, Jan 09, 2015 at 11:46:32AM -0800, K Yoshimoto wrote:
> > >>Marlon,
> > >>
> > >>  I can do the startup with ./airavata-server.sh for now.
> > >>
> > >>  I'm trying to go through the steps of creating my own app and
> > >>launching it using the Python client.  I ran into a problem with
> > >>a method not found in the client:
> > >>
> > >>In 
> > >>airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apache/airavata/api
> > >>
> > >>./Airavata-remote -h localhost:8930 getAllcomputeResourceNames
> > >>Unrecognized method getAllcomputeResourceNames
> > >>
> > >>  Should the python client be up-to-date?
> > >>
> > >>Kenneth
> > >>
> > >>On Thu, Jan 08, 2015 at 08:08:58PM -0500, Marlon Pierce wrote:
> > >>>Hi Ken--
> > >>>
> > >>>Thanks--feel free to fix the startup script and submit a patch.
> > >>>
> > >>>Marlon
> > >>>
> > >>>On 1/8/15 6:28 PM, K Yoshimoto wrote:
> > >>>>I grabbed the source release from
> > >>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
> > >>>>
> > >>>>and built that.  The server startup script is still broken for
> > >>>>Ubuntu when run as the quick start describes (sh airavata-server.sh),
> > >>>>but works when invoked as ./airavata-server.sh.
> > >>>>
> > >>>>Registering sample apps and xbaya workflow construction work.
> > >>>>Not sure when the xbaya workflow construction would be useful?
> > >>>>Running the workflow generates output in /tmp.
> > >>>>
> > >>>>I would like to try creating new experiments and running them.
> > >>>>I will be playing with the python client.  Are all the samples in
> > >>>>airavata-0.14/airavata-api/airavata-client-sdks/java-client-samples/src/main/java/org/apache/airavata/client/samples
> > >>>>
> > >>>>up-to-date?  I'll probably go by them to try registering new experiments
> > >>>>and running them with the python client, unless anyone has documentation
> > >>>>handy.
> > >>>>
> > >>>>Kenneth
> > >>>>
> > >>>>On Wed, Jan 07, 2015 at 12:56:00PM -0500, Marlon Pierce wrote:
> > >>>>>We also run the server components (not XBaya) full time and
run daily
> > >>>>>tests against it as part of test-drive.airavata.org.
> > >>>>>
> > >>>>>Marlon
> > >>>>>
> > >>>>>On 1/7/15 12:31 PM, K Yoshimoto wrote:
> > >>>>>>Was it stable enough to use outside the demo?  Any problems
to note?
> > >>>>>>
> > >>>>>>On Wed, Jan 07, 2015 at 10:48:58PM +0530, Suresh Marru wrote:
> > >>>>>>>+ 1 for the release.
> > >>>>>>>
> > >>>>>>>P.S. I was able to demo this RC2 in a talk and couple
of participants
> > >>>>>>>followed along successfully.
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>On Dec 30, 2014, at 1:34 AM, Chathuri Wimalasena 
> > >>>>>>><kamalasini@gmail.com>
> > >>>>>>>wrote:
> > >>>>>>>
> > >>>>>>>>Apache Airavata PMC is pleased to call for a vote
on the following
> > >>>>>>>>Apache Airavata 0.14 release candidate artifacts:
> > >>>>>>>>
> > >>>>>>>>Detailed change log/release notes:
> > >>>>>>>>
> > >>>>>>>>https://git-wip-us.apache.org/repos/asf?p=airavata.git;a=blob_plain;f=RELEASE_NOTES;hb=refs/tags/airavata-0.14
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>All Release Artifacts:
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>PGP release keys (signed using 65541DBC):
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/release/airavata/KEYS
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>Specific URL's:
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>GIT source tag:
> > >>>>>>>>https://git-wip-us.apache.org/repos/asf?p=airavata.git;a=shortlog;h=refs/tags/airavata-0.14
> > >>>>>>>>
> > >>>>>>>>Source release:
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/airavata-0.14-source-release.zip
> > >>>>>>>>
> > >>>>>>>>Binary Artifacts:
> > >>>>>>>>
> > >>>>>>>>Airavata Server:
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-server-0.14-bin.zip
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-server-0.14-bin.tar.gz
> > >>>>>>>>
> > >>>>>>>>API Server
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-api-server-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-api-server-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>GFac Server
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-gfac-server-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-gfac-server-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>Orchestrator Server
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-orchestrator-server-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-orchestrator-server-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>Xbaya Distribution
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-xbaya-gui-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-xbaya-gui-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>Client SDKs
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-java-sdk-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-java-sdk-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-php-sdk-0.14-bin.tar.gz
> > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apache-airavata-client-php-sdk-0.14-bin.zip
> > >>>>>>>>
> > >>>>>>>>Maven staging repo:
> > >>>>>>>>https://repository.apache.org/content/repositories/orgapacheairavata-1005
> > >>>>>>>>
> > >>>>>>>>Please verify the artifacts and vote. The vote will
be open for 
> > >>>>>>>>atleast
> > >>>>>>>>72 hours.
> > >>>>>>>>
> > >>>>>>>>[ ] +1  approve
> > >>>>>>>>[ ] +0  no opinion
> > >>>>>>>>[ ] -1  disapprove (and reason why)
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>[ ] +1  approve
> > >>>>>>>>[ ] +0  no opinion
> > >>>>>>>>[ ] -1  disapprove (and reason why)
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>

Mime
View raw message