On T= ue, Sep 8, 2015 at 11:44 AM, Florian Heyl <f.heyl@gmx.de> wrote:=

Dear= Sir or Madam,

Me and my colleague are developing a pipeline based on s= cala and java to classify cancer stages. This pipeline should be uploaded o= n the hdfs (apache flink).

The pipeline locally works fine but on= the hdfs it crashes with the following error (see below). The main method = is simply structured we are only passing one argument to set the working di= rectory and then other methods from different scala and java files are call= ed. Sorry if I can not give you more details because I can not figure out w= hat the exact problem is. I hope you can help me.

= Best wishes,

Flo

<= div style=3D"text-align:left">=C2=A0An error occurred while invoking the program:

The main method caused an error.

java.io.IOException: Class =
not found
	at c=
om.esotericsoftware.reflectasm.shaded.org.objectweb.asm.ClassReader.a(Unkno=
wn Source)	at com.esotericsoftware.ref=
lectasm.shaded.org.objectweb.asm.ClassReader.<init>(Unknown Source)	at org.apache.flink.api.scala.ClosureCl=
eaner$.org$apache$flink$api$scala$ClosureCleaner$$getClassReader(ClosureCle=
aner.scala:42)	at org.apache.flink.api.scala.ClosureCleaner$.getInner=
Classes(ClosureCleaner.scala:90)
pache.flink=
.api.scala.DataSet.clean(DataSet.scala:120)
	at org.apache.flink.ap	at org.apache.flink.api.scala.Clos=
ureCleaner$.clean(ClosureCleaner.scala:113)
	at org.
ai.scala.DataSet$$anon$6.<init>(DataSet.scala:437)
	at org.apache.flink.api.scala.DataSet.filter(DataSet.scala:436)
VI$sp(Regre=
ssion2.scala:98)
	at scala.collection.i=
mmutable.Range.	at AddFunctions$.splitIntoTrainingAndTest(AddFu=
nctions.scala:42)
	at Regression2$$anonfun$mainRegression$1.apply$m
cforeach$mVc$sp(Range.=
scala:141)
	at Regression2$.mainRegression(Regression2.scala:91)
	at MainClass$.main(MainClass.scala:41)
	at MainClass.main(MainClass.scala)
elegatingMethodAccessorImpl.invoke(Delegatin=
gMethodAccessorImpl	at sun.reflect.NativeMethodAccessorImpl.invoke0(N=
ative Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja=
va:62)
	at sun.reflect.
D.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(Packaged=
Program.java:437)
tOptimizedP=
lan(Client.java:229)
	at org.apache.fli=
nk.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet	a=
t org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForE=
xecution(PackagedProgram.java:353)
	at org.apache.flink.client.program.Client.g
e.java:186)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
doHandle(Co=
ntextHandler.java:965)
	at org.eclipse.=
jetty.servlet.ServletHandler	at org.eclipse.jetty.servlet.Servl=
etHandler.doHandle(ServletHandler.java:453)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler=
.java:227)
	at org.eclipse.jetty.server.handler.ContextHandler
..doScope(ServletHan=
dler.java:388)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.=
java:187)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.=
java:901)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.jav=
a:117)
ection.java=
:596)
	at org.eclipse.jetty.server.Http=
Connection$RequestHandler.	at org.eclipse.jetty.server.handler.=
HandlerList.handle(HandlerList.java:47)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.j=
ava:113)
	at org.eclipse.jetty.server.Server.handle(Server.java:352)
	at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpCon
nheade=
rComplete(HttpConnection.java:1048)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
	at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoin=
t.java:489)
	at org.eclipse.jetty.util.thread.Qu=
euedThreadPool$2.run(QueuedThreadPool.java:436)
	at java.lang.Thread.run(Thread.java=
:745)