Mailing-List: contact dev-help@airavata.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@airavata.apache.org
MIME-Version: 1.0
From: Shameera Rathnayaka <shameerainfo@gmail.com>
Date: Thu, 29 Sep 2016 19:44:59 +0000
Message-ID: <CAJvLytq_MqTSTt6QiY3TNHf__m8RMiD+ikAH=JDq7RgmUrhtDQ@mail.gmail.com>
Subject: Replace XSLT base script generation with more flexible Groovy Temaplates
To: dev <dev@airavata.apache.org>
Content-Type: multipart/alternative; boundary=001a1143fee21c87e8053daab7c3
archived-at: Thu, 29 Sep 2016 19:45:21 -0000

--001a1143fee21c87e8053daab7c3
Content-Type: text/plain; charset=UTF-8

Hi Devs,

We are using XSLT+ XSD + CodeGen to generate our job submission scripts.
Compare to our requirement(just to generate simple script)  we are using
heavy tools and adding unnecessary complications. Another downside is all
dependency we need to do this XSLT transformation cause to increase the
size of the airavata distribution. I am thinking of simple Groovy Template
base implementations to replace with this XSLT.  Compare to the learning
curve of both XSLT and Groovy where Groovy has simplest learning curve
compare to XSLT, it is easy to maintain groovy template that XSLT. I have
implemented PoC for Slurm job script and following is how it looks like.
If everyone ok I would like to work on this replacement.

#!${shellName}
<%
if (queueName != null) out.print '#SBATCH -p ' + queueName + '\n'
   if (nodes != null) out.print '#SBATCH -N ' + nodes + '\n'
   if (cpuCount != null) out.print '#SBATCH -n ' + cpuCount + '\n'
   if (mailAddress != null) out.print '#SBATCH --mail-user=' +
mailAddress + '\n'
   if (accountString != null) out.print '#SBATCH -A ' + accountString + '\n'
   if (maxWallTime != null) out.print '#SBATCH -t ' + maxWallTime + '\n'
   if (jobName != null) out.print '#SBATCH -J ' + jobName + '\n'
   if (standardOutFile != null) out.print '#SBATCH -o ' + standardOutFile + '\n'
   if (standardErrorFile != null) out.print '#SBATCH -e ' +
standardErrorFile + '\n'
   if (qualityOfService != null) out.print '#SBATCH --qos=' +
qualityOfService + '\n'
   if (reservation != null) out.print '#SBATCH --reservation=' +
reservation + '\n'
%>
#SBATCH --mail-type=ALL

<% if (exports != null) for(com in exports)  out.print 'export ' + com +'\n'
   if (moduleCommands != null) for(mc in moduleCommands)  out.print mc +'\n'
   if (workingDirectory != null)  out.print 'cd ' + workingDirectory +'\n'
   if (preJobCommands != null) for(pjc in preJobCommands)  out.print pjc +'\n'
   if (jobSubmitterCommand != null)  out.print jobSubmitterCommand + ' '
   if (executablePath != null)  out.print  executablePath + ' '
   if (inputs != null) for(input in inputs)  out.print input + ' '
   out.print '\n'
   if (postJobCommands != null) for(pjc in postJobCommands)  out.print pjc +'\n'
%>


Thanks,
Shameera.

-- 
Shameera Rathnayaka

--001a1143fee21c87e8053daab7c3
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Devs,=C2=A0<div><br></div><div>We are using XSLT+ XSD=
=C2=A0+ CodeGen to generate our job submission scripts. Compare to our requ=
irement(just to generate simple script) =C2=A0we are using heavy tools and =
adding unnecessary=C2=A0complications. Another downside is all dependency w=
e need to do this XSLT transformation cause to increase the size of the=C2=
=A0airavata=C2=A0distribution. I am thinking of simple Groovy Template base=
 implementations=C2=A0to replace with this XSLT.=C2=A0 Compare to the learn=
ing curve of both XSLT and Groovy where Groovy has simplest learning curve =
compare to XSLT, it is easy to maintain groovy template that XSLT. I have i=
mplemented PoC for Slurm job script and following=C2=A0is how it looks like=
.=C2=A0 If everyone ok I would like to work on this replacement.=C2=A0</div=
><div><br></div><div><pre style=3D"background-color:rgb(40,44,49);color:rgb=
(171,178,191);font-family:menlo;font-size:9pt">#!${shellName}<br>&lt;%<br>i=
f (queueName !=3D null) out.print &#39;#SBATCH -p &#39; + queueName + &#39;=
\n&#39;<br>   if (nodes !=3D null) out.print &#39;#SBATCH -N &#39; + nodes =
+ &#39;\n&#39;<br>   if (cpuCount !=3D null) out.print &#39;#SBATCH -n &#39=
; + cpuCount + &#39;\n&#39;<br>   if (mailAddress !=3D null) out.print &#39=
;#SBATCH --mail-user=3D&#39; + mailAddress + &#39;\n&#39;<br>   if (account=
String !=3D null) out.print &#39;#SBATCH -A &#39; + accountString + &#39;\n=
&#39;<br>   if (maxWallTime !=3D null) out.print &#39;#SBATCH -t &#39; + ma=
xWallTime + &#39;\n&#39;<br>   if (jobName !=3D null) out.print &#39;#SBATC=
H -J &#39; + jobName + &#39;\n&#39;<br>   if (standardOutFile !=3D null) ou=
t.print &#39;#SBATCH -o &#39; + standardOutFile + &#39;\n&#39;<br>   if (st=
andardErrorFile !=3D null) out.print &#39;#SBATCH -e &#39; + standardErrorF=
ile + &#39;\n&#39;<br>   if (qualityOfService !=3D null) out.print &#39;#SB=
ATCH --qos=3D&#39; + qualityOfService + &#39;\n&#39;<br>   if (reservation =
!=3D null) out.print &#39;#SBATCH --reservation=3D&#39; + reservation + =
9;\n&#39;<br>%&gt;<br>#SBATCH --mail-type=3DALL<br><br>&lt;% if (exports !=
=3D null) for(com in exports)  out.print &#39;export &#39; + com +&#39;\n&#=
39;<br>   if (moduleCommands !=3D null) for(mc in moduleCommands)  out.prin=
t mc +&#39;\n&#39;<br>   if (workingDirectory !=3D null)  out.print &#39;cd=
 &#39; + workingDirectory +&#39;\n&#39;<br>   if (preJobCommands !=3D null)=
 for(pjc in preJobCommands)  out.print pjc +&#39;\n&#39;<br>   if (jobSubmi=
tterCommand !=3D null)  out.print jobSubmitterCommand + &#39; &#39;<br>   i=
f (executablePath !=3D null)  out.print  executablePath + &#39; &#39;<br>  =
 if (inputs !=3D null) for(input in inputs)  out.print input + &#39; &#39;<=
br>   out.print &#39;\n&#39;<br>   if (postJobCommands !=3D null) for(pjc i=
n postJobCommands)  out.print pjc +&#39;\n&#39;<br>%&gt;</pre></div><div><b=
r></div><div><br></div><div>Thanks,</div><div>Shameera.</div><div><br></div=
></div><div dir=3D"ltr">-- <br></div><div data-smartmail=3D"gmail_signature=
"><div dir=3D"ltr">Shameera Rathnayaka</div></div>

--001a1143fee21c87e8053daab7c3--