Mailing-List: contact dev-help@airavata.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@airavata.apache.org
Received-SPF: pass (nike.apache.org: local policy)
Date: Wed, 21 Jan 2015 11:06:26 -0800
From: K Yoshimoto <kenneth@sdsc.edu>
To: dev@airavata.apache.org
Subject: job description in experiment creation?
Message-ID: <20150121190626.GI14754@merrimac.sdsc.edu>
References: <762FACC6-33E5-44B2-B2E1-5EDC4D238BBD@apache.org>
 <20150107173108.GA11156@merrimac.sdsc.edu> <54AD7330.8040003@iu.edu>
 <20150108232822.GA24339@merrimac.sdsc.edu> <54AF2A2A.1030507@iu.edu>
 <20150109194632.GF29153@merrimac.sdsc.edu>
 <20150109211531.GG29153@merrimac.sdsc.edu> <54B04C99.6060107@iu.edu>
 <20150109232639.GJ29153@merrimac.sdsc.edu>
 <20150116224620.GY8590@merrimac.sdsc.edu>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
In-Reply-To: <20150116224620.GY8590@merrimac.sdsc.edu>
User-Agent: Mutt/1.4.2.2i


I was able to launch the example experiment and get output
from the Xbaya quickstart:

https://cwiki.apache.org/confluence/display/AIRAVATA/XBAYA+Quick-Start+Tuto=
rial

I am trying to create and launch my own custom experiment with
the Airavata-remote python client.  However, I'm getting this error
on the server side:

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_D=
ESCRIPTION'  cannot accept a NULL value. {prepstmnt 1346602387
INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
        CREATION_TIME, JOB_DESCRIPTION)
    VALUES (?, ?, ?, ?, ?)
[params=3D(String) IDontNeedaNode_153cb823-1b52-400f-b458-c619fd69c9a6, (St=
ring) IDontNeedaNode_153cb823-1b52-400f-b458-c619fd69c9a6, (null) null, (Ti=
mestamp) 2015-01-21 10:16:28.985, (null) null]} [code=3D-1, state=3D23502]


Where does JOB_DESCRIPTION get input into the experiment?

Kenneth

On Fri, Jan 16, 2015 at 02:46:20PM -0800, K Yoshimoto wrote:
>=20
>  Is there a difference in the experiments that get created
> through xbaya workflow creation and through commandline
> createExperiment?  I can clone and run the xbaya experiment
> through the Python API client, but when I try creating my own
> experiment, the run fails.  Perhaps someone can send out
> the attributes required by createExperiment for creating a runnable
> experiment on localhost?
>=20
> Kenneth
>=20
> On Fri, Jan 09, 2015 at 03:26:39PM -0800, K Yoshimoto wrote:
> >=20
> > Marlon,
> >=20
> >  I'm finding all the structures I'm trying to use.  Do the other
> > thrift files get pulled in with the include lines?
> >=20
> >  I got to the point of trying to launch an experiment but ran into
> > an error.  Maybe I'm missing a field in my experiment?  Does anyone
> > have a blow-by-blow set of steps for creating a project, creating
> > an experiment, launching the experiment?
> >=20
> > ./Airavata-remote -h localhost:8930 getAllUserExperiments kenneth1
> > [ Experiment(userName=3D'kenneth1', experimentOutputs=3D[], errors=3DNo=
ne, applicationVersion=3DNone, name=3D'dateexperiment', workflowTemplateId=
=3DNone, projectID=3D'test1_cfe50d5c-6d70-4119-a485-f879943ecfea', stateCha=
ngeList=3D[WorkflowNodeStatus(timeOfStateChange=3D1420844997906, workflowNo=
deState=3D7)], creationTime=3D1420844856258, workflowNodeDetailsList=3D[Wor=
kflowNodeDetails(nodeInstanceId=3D'IDontNeedaNode_ff3cbbb8-e752-4be6-916d-b=
3a0fc252826', errors=3D[], nodeName=3D'IDontNeedaNode', nodeOutputs=3D[], e=
xecutionUnitData=3DNone, workflowNodeStatus=3DWorkflowNodeStatus(timeOfStat=
eChange=3D1420844997906, workflowNodeState=3D7), creationTime=3D14208449978=
71, executionUnit=3D1, taskDetailsList=3D[TaskDetails(applicationInputs=3D[=
], errors=3D[], applicationVersion=3DNone, applicationOutputs=3D[], applica=
tionDeploymentId=3DNone, advancedOutputDataHandling=3DNone, creationTime=3D=
None, dataTransferDetailsList=3D[], taskStatus=3DTaskStatus(timeOfStateChan=
ge=3D1420844997950, executionState=3D12), advancedInputDataHandling=3DNone,=
 taskID=3D'IDontNeedaNode_7b028bba-52b7-402a-b9d2-41b43796d675', jobDetails=
List=3D[], taskScheduling=3DNone, applicationId=3D'datetest_7292e719-beea-4=
872-b6a2-b6b76c28f3ee')], nodeInputs=3D[])], experimentID=3D'dateexperiment=
_e139d6e8-de9a-47f8-8c05-ee606f1c0ca0', workflowTemplateVersion=3DNone, wor=
kflowExecutionInstanceId=3DNone, userConfigurationData=3DNone, experimentIn=
puts=3D[], experimentStatus=3DExperimentStatus(timeOfStateChange=3D14208448=
56279, experimentState=3D0), applicationId=3D'datetest_7292e719-beea-4872-b=
6a2-b6b76c28f3ee', description=3DNone)]
> >=20
> > ./Airavata-remote -h localhost:8930 launchExperiment dateexperiment_e13=
9d6e8-de9a-47f8-8c05-ee606f1c0ca0 runme
> > Traceback (most recent call last):
> >   File "./Airavata-remote", line 301, in <module>
> >     pp.pprint(client.launchExperiment(args[0],args[1],))
> >   File "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift=
-interface-descriptions/gen-py/apache/airavata/api/Airavata.py", line 2572,=
 in launchExperiment
> >     self.recv_launchExperiment()
> >   File "/media/scigap/scigap/0.14.RC2/airavata-0.14/airavata-api/thrift=
-interface-descriptions/gen-py/apache/airavata/api/Airavata.py", line 2589,=
 in recv_launchExperiment
> >     raise x
> > thrift.Thrift.TApplicationException: Internal error processing launchEx=
periment
> >=20
> >=20
> > From the server console:
> >=20
> > [ERROR] Error occurred during processing of message.
> > java.lang.NullPointerException
> >         at org.apache.airavata.orchestrator.core.validator.impl.SimpleA=
ppDataValidator.validate(SimpleAppDataValidator.java:50)
> >         at org.apache.airavata.orchestrator.cpi.impl.SimpleOrchestrator=
Impl.validateExperiment(SimpleOrchestratorImpl.java:120)
> >         at org.apache.airavata.orchestrator.server.OrchestratorServerHa=
ndler.validateExperiment(OrchestratorServerHandler.java:252)
> >         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Pro=
cessor$validateExperiment.getResult(OrchestratorService.java:552)
> >         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Pro=
cessor$validateExperiment.getResult(OrchestratorService.java:536)
> >         at org.apache.thrift.ProcessFunction.process(ProcessFunction.ja=
va:39)
> >         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java=
:39)
> >         at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run=
(TThreadPoolServer.java:225)
> >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool=
Executor.java:1146)
> >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo=
lExecutor.java:615)
> >         at java.lang.Thread.run(Thread.java:701)
> > [ERROR] Internal error processing launchExperiment
> > org.apache.thrift.transport.TTransportException
> >         at org.apache.thrift.transport.TIOStreamTransport.read(TIOStrea=
mTransport.java:132)
> >         at org.apache.thrift.transport.TTransport.readAll(TTransport.ja=
va:84)
> >         at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryPr=
otocol.java:362)=20
> >         at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryPr=
otocol.java:284)=20
> >         at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(=
TBinaryProtocol.java:191)
> >         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.=
java:69)
> >         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Cli=
ent.recv_validateExperiment(OrchestratorService.java:239)
> >         at org.apache.airavata.orchestrator.cpi.OrchestratorService$Cli=
ent.validateExperiment(OrchestratorService.java:226)
> >         at org.apache.airavata.api.server.handler.AiravataServerHandler=
.launchExperiment(AiravataServerHandler.java:1118)
> >         at org.apache.airavata.api.Airavata$Processor$launchExperiment.=
getResult(Airavata.java:8929)
> >         at org.apache.airavata.api.Airavata$Processor$launchExperiment.=
getResult(Airavata.java:8913)
> >         at org.apache.thrift.ProcessFunction.process(ProcessFunction.ja=
va:39)
> >         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java=
:39)
> >         at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run=
(TThreadPoolServer.java:225)
> >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool=
Executor.java:1146)
> >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo=
lExecutor.java:615)
> >         at java.lang.Thread.run(Thread.java:701)
> >=20
> >=20
> > On Fri, Jan 09, 2015 at 04:48:09PM -0500, Marlon Pierce wrote:
> > > Hi Kenneth--
> > >=20
> > > You'll probably run into problems with the python bindings, but it is=
 an=20
> > > easy fix (I think).  The thrift files need to specify the language=20
> > > bindings you want. Only three of the thrift files have python binding=
s=20
> > > set up.
> > >=20
> > > Marlon
> > >=20
> > >=20
> > > thrift-interface-descriptions mpierce$ find . -type f -exec grep -il=
=20
> > > "namespace py" {} \;
> > > ./airavataAPI.thrift
> > > ./airavataErrors.thrift
> > > ./workflowAPI.thrift
> > >=20
> > >=20
> > > On 1/9/15 4:15 PM, K Yoshimoto wrote:
> > > >Okay, looks like the C in Compute needs to be capitalized.
> > > >I must have typoed that.
> > > >
> > > >On Fri, Jan 09, 2015 at 11:46:32AM -0800, K Yoshimoto wrote:
> > > >>Marlon,
> > > >>
> > > >>  I can do the startup with ./airavata-server.sh for now.
> > > >>
> > > >>  I'm trying to go through the steps of creating my own app and
> > > >>launching it using the Python client.  I ran into a problem with
> > > >>a method not found in the client:
> > > >>
> > > >>In=20
> > > >>airavata-0.14/airavata-api/thrift-interface-descriptions/gen-py/apa=
che/airavata/api
> > > >>
> > > >>./Airavata-remote -h localhost:8930 getAllcomputeResourceNames
> > > >>Unrecognized method getAllcomputeResourceNames
> > > >>
> > > >>  Should the python client be up-to-date?
> > > >>
> > > >>Kenneth
> > > >>
> > > >>On Thu, Jan 08, 2015 at 08:08:58PM -0500, Marlon Pierce wrote:
> > > >>>Hi Ken--
> > > >>>
> > > >>>Thanks--feel free to fix the startup script and submit a patch.
> > > >>>
> > > >>>Marlon
> > > >>>
> > > >>>On 1/8/15 6:28 PM, K Yoshimoto wrote:
> > > >>>>I grabbed the source release from
> > > >>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
> > > >>>>
> > > >>>>and built that.  The server startup script is still broken for
> > > >>>>Ubuntu when run as the quick start describes (sh airavata-server.=
sh),
> > > >>>>but works when invoked as ./airavata-server.sh.
> > > >>>>
> > > >>>>Registering sample apps and xbaya workflow construction work.
> > > >>>>Not sure when the xbaya workflow construction would be useful?
> > > >>>>Running the workflow generates output in /tmp.
> > > >>>>
> > > >>>>I would like to try creating new experiments and running them.
> > > >>>>I will be playing with the python client.  Are all the samples in
> > > >>>>airavata-0.14/airavata-api/airavata-client-sdks/java-client-sampl=
es/src/main/java/org/apache/airavata/client/samples
> > > >>>>
> > > >>>>up-to-date?  I'll probably go by them to try registering new expe=
riments
> > > >>>>and running them with the python client, unless anyone has docume=
ntation
> > > >>>>handy.
> > > >>>>
> > > >>>>Kenneth
> > > >>>>
> > > >>>>On Wed, Jan 07, 2015 at 12:56:00PM -0500, Marlon Pierce wrote:
> > > >>>>>We also run the server components (not XBaya) full time and run =
daily
> > > >>>>>tests against it as part of test-drive.airavata.org.
> > > >>>>>
> > > >>>>>Marlon
> > > >>>>>
> > > >>>>>On 1/7/15 12:31 PM, K Yoshimoto wrote:
> > > >>>>>>Was it stable enough to use outside the demo?  Any problems to =
note?
> > > >>>>>>
> > > >>>>>>On Wed, Jan 07, 2015 at 10:48:58PM +0530, Suresh Marru wrote:
> > > >>>>>>>+ 1 for the release.
> > > >>>>>>>
> > > >>>>>>>P.S. I was able to demo this RC2 in a talk and couple of parti=
cipants
> > > >>>>>>>followed along successfully.
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>>On Dec 30, 2014, at 1:34 AM, Chathuri Wimalasena=20
> > > >>>>>>><kamalasini@gmail.com>
> > > >>>>>>>wrote:
> > > >>>>>>>
> > > >>>>>>>>Apache Airavata PMC is pleased to call for a vote on the foll=
owing
> > > >>>>>>>>Apache Airavata 0.14 release candidate artifacts:
> > > >>>>>>>>
> > > >>>>>>>>Detailed change log/release notes:
> > > >>>>>>>>
> > > >>>>>>>>https://git-wip-us.apache.org/repos/asf?p=3Dairavata.git;a=3D=
blob_plain;f=3DRELEASE_NOTES;hb=3Drefs/tags/airavata-0.14
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>All Release Artifacts:
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>PGP release keys (signed using 65541DBC):
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/release/airavata/KEYS
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>Specific URL's:
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>GIT source tag:
> > > >>>>>>>>https://git-wip-us.apache.org/repos/asf?p=3Dairavata.git;a=3D=
shortlog;h=3Drefs/tags/airavata-0.14
> > > >>>>>>>>
> > > >>>>>>>>Source release:
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/aira=
vata-0.14-source-release.zip
> > > >>>>>>>>
> > > >>>>>>>>Binary Artifacts:
> > > >>>>>>>>
> > > >>>>>>>>Airavata Server:
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-airavata-server-0.14-bin.zip
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-airavata-server-0.14-bin.tar.gz
> > > >>>>>>>>
> > > >>>>>>>>API Server
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-api-server-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-api-server-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>GFac Server
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-gfac-server-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-gfac-server-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>Orchestrator Server
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-orchestrator-server-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-orchestrator-server-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>Xbaya Distribution
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-airavata-xbaya-gui-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-airavata-xbaya-gui-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>Client SDKs
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-airavata-client-java-sdk-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-airavata-client-java-sdk-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-airavata-client-php-sdk-0.14-bin.tar.gz
> > > >>>>>>>>https://dist.apache.org/repos/dist/dev/airavata/0.14/RC2/apac=
he-airavata-client-php-sdk-0.14-bin.zip
> > > >>>>>>>>
> > > >>>>>>>>Maven staging repo:
> > > >>>>>>>>https://repository.apache.org/content/repositories/orgapachea=
iravata-1005
> > > >>>>>>>>
> > > >>>>>>>>Please verify the artifacts and vote. The vote will be open f=
or=20
> > > >>>>>>>>atleast
> > > >>>>>>>>72 hours.
> > > >>>>>>>>
> > > >>>>>>>>[ ] +1  approve
> > > >>>>>>>>[ ] +0  no opinion
> > > >>>>>>>>[ ] -1  disapprove (and reason why)
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>[ ] +1  approve
> > > >>>>>>>>[ ] +0  no opinion
> > > >>>>>>>>[ ] -1  disapprove (and reason why)
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>