reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julia Wang (QIUHE)" <Qiuhe.W...@microsoft.com>
Subject RE: Issues with running on yarn
Date Wed, 13 Apr 2016 01:03:24 GMT
After a clean build, I got same error. Pick up any REEF functional test, it will fail at beginning
of Driver start. 

____________________________
SEVERE: Unable to instantiate the clock
java.lang.NoSuchMethodError: getDefinedRuntimes
	at org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(Native Method)
	at org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.getClrHandlers(DriverStartClrHandlersInitializer.java:47)
	at org.apache.reef.javabridge.generic.JobDriver.setupBridge(JobDriver.java:196)
	at org.apache.reef.javabridge.generic.JobDriver.access$1500(JobDriver.java:66)
	at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:583)
	at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:577)
	at org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(DriverStartHandler.java:93)
	at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:71)
	at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:40)
	at org.apache.reef.wake.impl.PubSubEventHandler.onNext(PubSubEventHandler.java:98)
	at org.apache.reef.wake.time.runtime.RuntimeClock.run(RuntimeClock.java:217)
	at org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:175)
__________________
Option 0 [-XX:PermSize=128m]
Option 1 [-XX:MaxPermSize=128m]
Option 2 [-Xmx512m]
Option 3 [-Djava.class.path=;C:\reef\ReefApache\reef1\lang\cs\bin\x64\Debug\Org.Apache.REEF.Tests\REEF_LOCAL_RUNTIME6ae4196f\reef-ContextStartDriver-20160412174234260\driver\reef\global\reef-bridge-client-0.15.0-SNAPSHOT-shaded.jar;C:\reef\ReefApache\reef1\lang\cs\bin\x64\Debug\Org.Apache.REEF.Tests\.\reef-bridge-client-0.15.0-SNAPSHOT-shaded.jar]
Option 4 [-Dproc_reef]
Found class 'org/apache/reef/javabridge/NativeInterop'<C++>InteropUtil Information:
0 : 2016-04-12T17:43:23.0956095-07:00 0001
INFO: +Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler
<C++> Start: 0 : 2016-04-12T17:43:23.1036094-07:00 0001
START: EvaluatorRequestorClr2Java::EvaluatorRequestorClr2Java
<C++> Stop: 0 : 2016-04-12T17:43:23.1041093-07:00 0001
EXIT: EvaluatorRequestorClr2Java::EvaluatorRequestorClr2Java
<C++> Start: 0 : 2016-04-12T17:43:23.1526168-07:00 0001
START: EvaluatorRequestorClr2Java::GetDefinedRuntimes
 jmidGetDefinedRuntimes is NULL
<C++>InteropUtil Error: 0 : 2016-04-12T17:43:23.4991608-07:00 0001
ERROR: Exceptions in Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandlerencountered
error [System.ArgumentNullException: Buffer cannot be null.
Parameter name: buffer
   at System.IO.MemoryStream..ctor(Byte[] buffer, Boolean writable)
   at Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBytes(Byte[] serializedData)
   at Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEvaluatorRequestorClr2Java
clr2Java)
   at Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemStartHandler_OnStart(DateTime
startTime, String httpServerPort, IEvaluatorRequestorClr2Java evaluatorRequestorClr2Java)
   at Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler(JNIEnv_* env,
_jclass* jclassx, _jstring* dateTimeString, _jstring* httpServerPort, _jobject* jbridgeHandlerManager,
_jobject* jevaluatorRequestorBridge)] with mesage [Buffer cannot be null.
Parameter name: buffer] and stack trace [   at System.IO.MemoryStream..ctor(Byte[] buffer,
Boolean writable)
   at Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBytes(Byte[] serializedData)
   at Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEvaluatorRequestorClr2Java
clr2Java)
   at Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemStartHandler_OnStart(DateTime
startTime, String httpServerPort, IEvaluatorRequestorClr2Java evaluatorRequestorClr2Java)
   at Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler(JNIEnv_* env,
_jclass* jclassx, _jstring* dateTimeString, _jstring* httpServerPort, _jobject* jbridgeHandlerManager,
_jobject* jevaluatorRequestorBridge)]

-----Original Message-----
From: Markus Weimer [mailto:markus@weimo.de] 
Sent: Tuesday, April 12, 2016 5:22 PM
To: dev@reef.apache.org
Subject: Re: Issues with running on yarn

On 2016-04-12 16:50, Dhruv Mahajan wrote:
> I see very wierd....Lemme again try rerunning...I was doing:
>
> mvn clean install -DskipTests followed by compiling C# code. Lemme retry.

I am very paranoid when it comes to clean builds and execute the following as a clean in powershell:

```
function Clean-REEF{
   Invoke-Expression 'msbuild
$REEFSourcePath\lang\cs\Org.Apache.REEF.sln /m /nr:false /t:Clean'
   # Perform some more deletes because I don't trust MSBuild
   Stop-Process -Force -Name MSBuild
   Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter obj 
             | Remove-Item -Recurse
   Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter bin 
             | Remove-Item -Recurse
   Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter target 
             | Remove-Item -Recurse
   Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter REEF_LOCAL_RUNTIME | Remove-Item
-Recurse
   Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter 
TestResults        | Remove-Item -Recurse
   Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter 
packages           | Remove-Item -Recurse
}
```

This deletes everything, including the downloaded NuGets.

Markus
Mime
View raw message