reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dhruv Mahajan <dhruv.maha...@gmail.com>
Subject Re: Issues with running on yarn
Date Tue, 12 Apr 2016 23:50:18 GMT
I see very wierd....Lemme again try rerunning...I was doing:

mvn clean install -DskipTests followed by compiling C# code. Lemme retry.

Dhruv

On Tue, Apr 12, 2016 at 4:49 PM, Boris Shulman <shulmanb@gmail.com> wrote:

> I have unit test that launch local runtime, so it is strange that this is
> broken for you.
>
> On Tue, Apr 12, 2016 at 4:26 PM, Dhruv Mahajan <dhruv.mahajan@gmail.com>
> wrote:
>
> > Thks.
> >
> > On Tue, Apr 12, 2016 at 4:25 PM, Boris Shulman <shulmanb@gmail.com>
> wrote:
> >
> > > Will look into that later today. This is related to my latest PR.
> > >
> > > On Tue, Apr 12, 2016 at 4:20 PM, Dhruv Mahajan <
> dhruv.mahajan@gmail.com>
> > > wrote:
> > >
> > > > Hi
> > > >
> > > > I just did merge with master and I got errors in driver. I am
> attaching
> > > the
> > > > errors. I had updated branch 1-2 days ago and it was all fine. I am
> > > > attaching stderr and stdout logs below.
> > > >
> > > > stdout:
> > > >
> > > > START: EvaluatorRequestorClr2Java::GetDefinedRuntimes
> > > >  jmidGetDefinedRuntimes is NULL
> > > > <C++>InteropUtil Error: 0 : 2016-04-12T16:09:14.7757809-07:00 0001
> > > > ERROR: Exceptions in
> > > >
> > > >
> > >
> >
> Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandlerencountered
> > > > error [System.ArgumentNullException: Buffer cannot be null.
> > > > Parameter name: buffer
> > > >    at System.IO.MemoryStream..ctor(Byte[] buffer, Boolean writable)
> > > >    at
> > > >
> > >
> >
> Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBytes(Byte[]
> > > > serializedData)
> > > >    at
> > > >
> > >
> >
> Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEvaluatorRequestorClr2Java
> > > > clr2Java)
> > > >    at
> > > >
> > >
> >
> Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemStartHandler_OnStart(DateTime
> > > > startTime, String httpServerPort, IEvaluatorRequestorClr2Java
> > > > evaluatorRequestorClr2Java)
> > > >    at
> > > >
> > >
> >
> Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler(JNIEnv_*
> > > > env, _jclass* jclassx, _jstring* dateTimeString, _jstring*
> > > > httpServerPort, _jobject* jbridgeHandlerManager, _jobject*
> > > > jevaluatorRequestorBridge)] with mesage [Buffer cannot be null.
> > > > Parameter name: buffer] and stack trace [   at
> > > > System.IO.MemoryStream..ctor(Byte[] buffer, Boolean writable)
> > > >    at
> > > >
> > >
> >
> Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBytes(Byte[]
> > > > serializedData)
> > > >    at
> > > >
> > >
> >
> Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEvaluatorRequestorClr2Java
> > > > clr2Java)
> > > >    at
> > > >
> > >
> >
> Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemStartHandler_OnStart(DateTime
> > > > startTime, String httpServerPort, IEvaluatorRequestorClr2Java
> > > > evaluatorRequestorClr2Java)
> > > >    at
> > > >
> > >
> >
> Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler(JNIEnv_*
> > > > env, _jclass* jclassx, _jstring* dateTimeString, _jstring*
> > > > httpServerPort, _jobject* jbridgeHandlerManager, _jobject*
> > > > jevaluatorRequestorBridge)]
> > > >
> > > >
> > > > stderr:
> > > >
> > > > INFO: Clock.close()
> > > > Apr 12, 2016 4:09:14 PM
> > > > org.apache.reef.runtime.common.launch.REEFErrorHandler onNext
> > > > SEVERE: Uncaught exception.
> > > > java.lang.NoSuchMethodError: getDefinedRuntimes
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(Native
> > > > Method)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.getClrHandlers(DriverStartClrHandlersInitializer.java:47)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver.setupBridge(JobDriver.java:196)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver.access$1500(JobDriver.java:66)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:583)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:577)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(DriverStartHandler.java:93)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:71)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:40)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.wake.impl.PubSubEventHandler.onNext(PubSubEventHandler.java:98)
> > > >         at
> > > >
> > org.apache.reef.wake.time.runtime.RuntimeClock.run(RuntimeClock.java:217)
> > > >         at
> > > >
> org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:175)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(YarnBootstrapREEFLauncher.java:65)
> > > >
> > > > Apr 12, 2016 4:09:14 PM
> > > > org.apache.reef.runtime.common.launch.REEFErrorHandler onNext
> > > > SEVERE: Caught an exception from Wake we cannot send upstream because
> > > > there is no upstream
> > > > Apr 12, 2016 4:09:14 PM org.apache.reef.runtime.common.REEFLauncher
> > fatal
> > > > SEVERE: Unable to instantiate the clock
> > > > java.lang.NoSuchMethodError: getDefinedRuntimes
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(Native
> > > > Method)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.getClrHandlers(DriverStartClrHandlersInitializer.java:47)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver.setupBridge(JobDriver.java:196)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver.access$1500(JobDriver.java:66)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:583)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:577)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(DriverStartHandler.java:93)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:71)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:40)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.wake.impl.PubSubEventHandler.onNext(PubSubEventHandler.java:98)
> > > >         at
> > > >
> > org.apache.reef.wake.time.runtime.RuntimeClock.run(RuntimeClock.java:217)
> > > >         at
> > > >
> org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:175)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(YarnBootstrapREEFLauncher.java:65)
> > > >
> > > > java.lang.RuntimeException: Unable to instantiate the clock
> > > >         at
> > > >
> > org.apache.reef.runtime.common.REEFLauncher.fatal(REEFLauncher.java:120)
> > > >         at
> > > >
> org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:179)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(YarnBootstrapREEFLauncher.java:65)
> > > > Caused by: java.lang.NoSuchMethodError: getDefinedRuntimes
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(Native
> > > > Method)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.getClrHandlers(DriverStartClrHandlersInitializer.java:47)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver.setupBridge(JobDriver.java:196)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver.access$1500(JobDriver.java:66)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:583)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:577)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(DriverStartHandler.java:93)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:71)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:40)
> > > >         at
> > > >
> > >
> >
> org.apache.reef.wake.impl.PubSubEventHandler.onNext(PubSubEventHandler.java:98)
> > > >         at
> > > >
> > org.apache.reef.wake.time.runtime.RuntimeClock.run(RuntimeClock.java:217)
> > > >         at
> > > >
> org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:175)
> > > >         ... 1 more
> > > >
> > > >
> > > > Thanks
> > > > Dhruv
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message