Mailing-List: contact dev-help@airavata.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@airavata.apache.org
MIME-Version: 1.0
In-Reply-To: <CAHzXhOiHrJ4WDhKATjzZXySwv9JPEFkA4nA4WPf=U-Z7q+wxGw@mail.gmail.com>
References: <CAHzXhOiHrJ4WDhKATjzZXySwv9JPEFkA4nA4WPf=U-Z7q+wxGw@mail.gmail.com>
From: Ajinkya Dhamnaskar <adhamnas@umail.iu.edu>
Date: Thu, 16 Nov 2017 13:51:23 -0800
Message-ID: <CAOhYq0unPQ7gs6Frg3dks8vfPaAqbCpqxYxR+9U5T7W5vQuq9Q@mail.gmail.com>
Subject: Re: Using job specific Participants in Helix
To: dimuthu.upeksha2@gmail.com
Cc: Airavata Dev <dev@airavata.apache.org>
Content-Type: multipart/alternative; boundary="001a113fe98c1093a3055e209f52"
archived-at: Thu, 16 Nov 2017 21:51:31 -0000

--001a113fe98c1093a3055e209f52
Content-Type: text/plain; charset="UTF-8"

Hey Dlmuthu,

Not an expert in Helix, but from exceptions it seems, system is entering in
a state not expected by reflection. I feel
https://github.com/apache/helix/blob/master/helix-core/src/main/java/org/apache/helix/messaging/handling/HelixStateTransitionHandler.java#L295
is triggering this exception.
As mentioned in the later part of the stack trace and from Helix Apache Docs
<http://helix.apache.org/0.7.1-docs/tutorial_agent.html> *("Helix is built
on the following assumption: if your distributed resource is modeled by a
finite state machine, then Helix can tell participants when they should
transition between states. In the Java API, this means implementing
transition callbacks. In the Helix agent API, this means providing commands
than can run for each transition"),* did you implement *transition
callback* for
these tasks?

On Thu, Nov 16, 2017 at 10:01 AM, DImuthu Upeksha <
dimuthu.upeksha2@gmail.com> wrote:

> Hi Devs,
>
> I'm working on the technology evaluation to re architecture Apache
> Airavata task execution framework and Helix seems like a good candidate for
> that as it has an in built distributed generic workflow execution
> capability. After going through several tutorials, I tried to implement a
> simple workflow on Helix to demonstrate following transition
>
> Data Collecting Job -> Command Executing Job -> Data Uploading Job
>
> I managed to implement this using a Participant node that includes all the
> tasks required for above workflow. However my goal is to implement
> specialized Participants for each Job type. For example, Participant 1
> knows only about the tasks to perform Data Collecting Job and Participant
> knows only about the task to perform Command Executing Job. When I tried to
> implement such Participants, I got following error from Participant 1. I
> can share the code samples that I have tried but before that I need to know
> whether my approach is compatible with Helix's design? Does Helix require
> all the Participants to be homogeneous?
>
> Executing data collecting
> 675892 [pool-2-thread-8] ERROR org.apache.helix.messaging.handling.HelixStateTransitionHandler
> - Exception while executing a state transition task Airavata_Workflow_
> commandExecuteJob_0
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.helix.messaging.handling.HelixStateTransitionHandler.invoke(
> HelixStateTransitionHandler.java:344)
> at org.apache.helix.messaging.handling.HelixStateTransitionHandler.
> handleMessage(HelixStateTransitionHandler.java:290)
> at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:84)
> at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:41)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.IllegalStateException: No callback implemented for
> task COMMAND
> at org.apache.helix.task.TaskStateModel.startTask(TaskStateModel.java:302)
> at org.apache.helix.task.TaskStateModel.onBecomeRunningFromInit(
> TaskStateModel.java:69)
> ... 12 more
> 675900 [pool-2-thread-8] ERROR org.apache.helix.participant.statemachine.StateModel
> - Default rollback method invoked on error. Error Code: ERROR
> 675908 [pool-2-thread-8] ERROR org.apache.helix.messaging.handling.HelixTask
> - Message execution failed. msgId: 8d9a08c9-0ae7-419a-8940-6b8e6e7c1ecb,
> errorMsg: java.lang.reflect.InvocationTargetException
> 675922 [pool-2-thread-8] ERROR org.apache.helix.messaging.handling.HelixStateTransitionHandler
> - Skip internal error. errCode: ERROR, errMsg: null
>
> Thanks
> Dimuthu
>


-- 
Thanks and regards,

Ajinkya Dhamnaskar
Student ID : 0003469679
Masters (CS)
+1 (812) 369- 5416

--001a113fe98c1093a3055e209f52
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hey Dlmuthu,<div><br></div><div>Not an expert in Helix, bu=
t from exceptions it seems, system is entering in a state not expected by r=
eflection. I feel=C2=A0<a href=3D"https://github.com/apache/helix/blob/mast=
er/helix-core/src/main/java/org/apache/helix/messaging/handling/HelixStateT=
ransitionHandler.java#L295">https://github.com/apache/helix/blob/master/hel=
ix-core/src/main/java/org/apache/helix/messaging/handling/HelixStateTransit=
ionHandler.java#L295</a> is triggering this exception.=C2=A0</div><div>As m=
entioned in the later part of the stack trace and from <a href=3D"http://he=
lix.apache.org/0.7.1-docs/tutorial_agent.html">Helix Apache Docs</a> <i>(&q=
uot;<span style=3D"color:rgb(51,51,51);font-family:&quot;Helvetica Neue&quo=
t;,Helvetica,Arial,sans-serif;font-size:14px">Helix is built on the followi=
ng assumption: if your distributed resource is modeled by a finite state ma=
chine, then Helix can tell participants when they should transition between=
 states. In the Java API, this means implementing transition callbacks. In =
the Helix agent API, this means providing commands than can run for each tr=
ansition&quot;),</span></i>=C2=A0did you implement=C2=A0<span style=3D"colo=
r:rgb(51,51,51);font-family:&quot;Helvetica Neue&quot;,Helvetica,Arial,sans=
-serif;font-size:14px"><b>transition callback</b>=C2=A0for these tasks?</sp=
an></div></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On=
 Thu, Nov 16, 2017 at 10:01 AM, DImuthu Upeksha <span dir=3D"ltr">&lt;<a hr=
ef=3D"mailto:dimuthu.upeksha2@gmail.com" target=3D"_blank">dimuthu.upeksha2=
@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=
=3D"ltr">Hi Devs,<div><br></div><div>I&#39;m working on the technology eval=
uation to re architecture Apache Airavata task execution framework and Heli=
x seems like a good candidate for that as it has an in built distributed ge=
neric workflow execution capability. After going through several tutorials,=
 I tried to implement a simple workflow on Helix to demonstrate following t=
ransition</div><div><br></div><div>Data Collecting Job -&gt; Command Execut=
ing Job -&gt; Data Uploading Job</div><div><br></div><div>I managed to impl=
ement this using a Participant node that includes all the tasks required fo=
r above workflow. However my goal is to implement specialized Participants =
for each Job type. For example, Participant 1 knows only about the tasks to=
 perform Data Collecting Job and Participant knows only about the task to p=
erform Command Executing Job. When I tried to implement such Participants, =
I got following error from Participant 1. I can share the code samples that=
 I have tried but before that I need to know whether my approach is compati=
ble with Helix&#39;s design? Does Helix require all the Participants to be=
=C2=A0homogeneous? =C2=A0</div><div><br></div><div><div>Executing data coll=
ecting</div><div>675892 [pool-2-thread-8] ERROR org.apache.helix.messaging.=
<wbr>handling.<wbr>HelixStateTransitionHandler=C2=A0 - Exception while exec=
uting a state transition task Airavata_Workflow_<wbr>commandExecuteJob_0</d=
iv><div>java.lang.reflect.<wbr>InvocationTargetException</div><div><span st=
yle=3D"white-space:pre-wrap">	</span>at sun.reflect.<wbr>NativeMethodAccess=
orImpl.<wbr>invoke0(Native Method)</div><div><span style=3D"white-space:pre=
-wrap">	</span>at sun.reflect.<wbr>NativeMethodAccessorImpl.<wbr>invoke(<wb=
r>NativeMethodAccessorImpl.java:<wbr>62)</div><div><span style=3D"white-spa=
ce:pre-wrap">	</span>at sun.reflect.<wbr>DelegatingMethodAccessorImpl.<wbr>=
invoke(<wbr>DelegatingMethodAccessorImpl.<wbr>java:43)</div><div><span styl=
e=3D"white-space:pre-wrap">	</span>at java.lang.reflect.Method.<wbr>invoke(=
Method.java:498)</div><div><span style=3D"white-space:pre-wrap">	</span>at =
org.apache.helix.messaging.<wbr>handling.<wbr>HelixStateTransitionHandler.<=
wbr>invoke(<wbr>HelixStateTransitionHandler.<wbr>java:344)</div><div><span =
style=3D"white-space:pre-wrap">	</span>at org.apache.helix.messaging.<wbr>h=
andling.<wbr>HelixStateTransitionHandler.<wbr>handleMessage(<wbr>HelixState=
TransitionHandler.<wbr>java:290)</div><div><span style=3D"white-space:pre-w=
rap">	</span>at org.apache.helix.messaging.<wbr>handling.HelixTask.call(<wb=
r>HelixTask.java:84)</div><div><span style=3D"white-space:pre-wrap">	</span=
>at org.apache.helix.messaging.<wbr>handling.HelixTask.call(<wbr>HelixTask.=
java:41)</div><div><span style=3D"white-space:pre-wrap">	</span>at java.uti=
l.concurrent.<wbr>FutureTask.run(FutureTask.<wbr>java:266)</div><div><span =
style=3D"white-space:pre-wrap">	</span>at java.util.concurrent.<wbr>ThreadP=
oolExecutor.runWorker(<wbr>ThreadPoolExecutor.java:1149)</div><div><span st=
yle=3D"white-space:pre-wrap">	</span>at java.util.concurrent.<wbr>ThreadPoo=
lExecutor$Worker.run(<wbr>ThreadPoolExecutor.java:624)</div><div><span styl=
e=3D"white-space:pre-wrap">	</span>at java.lang.Thread.run(Thread.<wbr>java=
:748)</div><div>Caused by: java.lang.<wbr>IllegalStateException: No callbac=
k implemented for task COMMAND</div><div><span style=3D"white-space:pre-wra=
p">	</span>at org.apache.helix.task.<wbr>TaskStateModel.startTask(<wbr>Task=
StateModel.java:302)</div><div><span style=3D"white-space:pre-wrap">	</span=
>at org.apache.helix.task.<wbr>TaskStateModel.<wbr>onBecomeRunningFromInit(=
<wbr>TaskStateModel.java:69)</div><div><span style=3D"white-space:pre-wrap"=
>	</span>... 12 more</div><div>675900 [pool-2-thread-8] ERROR org.apache.he=
lix.participant.<wbr>statemachine.StateModel=C2=A0 - Default rollback metho=
d invoked on error. Error Code: ERROR</div><div>675908 [pool-2-thread-8] ER=
ROR org.apache.helix.messaging.<wbr>handling.HelixTask=C2=A0 - Message exec=
ution failed. msgId: 8d9a08c9-0ae7-419a-8940-<wbr>6b8e6e7c1ecb, errorMsg: j=
ava.lang.reflect.<wbr>InvocationTargetException</div><div>675922 [pool-2-th=
read-8] ERROR org.apache.helix.messaging.<wbr>handling.<wbr>HelixStateTrans=
itionHandler=C2=A0 - Skip internal error. errCode: ERROR, errMsg: null</div=
></div><div><br></div><div>Thanks</div><span class=3D"HOEnZb"><font color=
=3D"#888888"><div>Dimuthu</div></font></span></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div class=
=3D"gmail_signature" data-smartmail=3D"gmail_signature"><div dir=3D"ltr"><f=
ont color=3D"#073763">Thanks and regards,</font><div><font color=3D"#073763=
"><br></font><div><font color=3D"#073763">Ajinkya Dhamnaskar</font></div><d=
iv><font color=3D"#073763">Student ID : 0003469679</font></div><div><font c=
olor=3D"#073763">Masters (CS)</font></div><div><font color=3D"#073763">+1 (=
812) 369- 5416</font></div></div></div></div>
</div>

--001a113fe98c1093a3055e209f52--