reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julia Wang (QIUHE)" <Qiuhe.W...@microsoft.com>
Subject RE: Issues with running on yarn
Date Tue, 12 Apr 2016 23:24:47 GMT
Did you do mvn clean install?

-----Original Message-----
From: Dhruv Mahajan [mailto:dhruv.mahajan@gmail.com] 
Sent: Tuesday, April 12, 2016 4:23 PM
To: dev@reef.apache.org
Subject: Re: Issues with running on yarn

Got same errors om local runtime too.

On Tue, Apr 12, 2016 at 4:20 PM, Dhruv Mahajan <dhruv.mahajan@gmail.com>
wrote:

> Hi
>
> I just did merge with master and I got errors in driver. I am 
> attaching the errors. I had updated branch 1-2 days ago and it was all 
> fine. I am attaching stderr and stdout logs below.
>
> stdout:
>
> START: EvaluatorRequestorClr2Java::GetDefinedRuntimes
>  jmidGetDefinedRuntimes is NULL
> <C++>InteropUtil Error: 0 : 2016-04-12T16:09:14.7757809-07:00 0001
> ERROR: Exceptions in Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandlerencountered
error [System.ArgumentNullException: Buffer cannot be null.
> Parameter name: buffer
>    at System.IO.MemoryStream..ctor(Byte[] buffer, Boolean writable)
>    at Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBytes(Byte[] serializedData)
>    at Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEvaluatorRequestorClr2Java
clr2Java)
>    at Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemStartHandler_OnStart(DateTime
startTime, String httpServerPort, IEvaluatorRequestorClr2Java evaluatorRequestorClr2Java)
>    at Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler(JNIEnv_*
env, _jclass* jclassx, _jstring* dateTimeString, _jstring* httpServerPort, _jobject* jbridgeHandlerManager,
_jobject* jevaluatorRequestorBridge)] with mesage [Buffer cannot be null.
> Parameter name: buffer] and stack trace [   at System.IO.MemoryStream..ctor(Byte[] buffer,
Boolean writable)
>    at Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBytes(Byte[] serializedData)
>    at Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEvaluatorRequestorClr2Java
clr2Java)
>    at Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemStartHandler_OnStart(DateTime
startTime, String httpServerPort, IEvaluatorRequestorClr2Java evaluatorRequestorClr2Java)
>    at 
> Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHand
> ler(JNIEnv_* env, _jclass* jclassx, _jstring* dateTimeString, 
> _jstring* httpServerPort, _jobject* jbridgeHandlerManager, _jobject* 
> jevaluatorRequestorBridge)]
>
>
> stderr:
>
> INFO: Clock.close()
> Apr 12, 2016 4:09:14 PM 
> org.apache.reef.runtime.common.launch.REEFErrorHandler onNext
> SEVERE: Uncaught exception.
> java.lang.NoSuchMethodError: getDefinedRuntimes
> 	at org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(Native Method)
> 	at org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.getClrHandlers(https://na01.safelinks.protection.outlook.com/?url=DriverStartClrHandlersInitializer.java%3a47&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=EH7QKRGkO1xvGCNkUcu9%2bu%2bzBwJgrIPfUKroTxI5uGg%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver.setupBridge(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a196&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=vt%2bK2Q%2bU6fPE2mvUeZjRxFwUQlkCoZdpTBVWgNzApxw%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver.access$1500(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a66&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MvIzspdLxt2LcBoGmrfvag0LgGYjBJ28ZpF2cUH8yaI%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a583&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=uImzpbuk3OVBSyopS1IDuNExUjreb%2b3C0jr3KsilfFo%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a577&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=Ntp4PIjOe1gDSbZE2hsc2znL9EmUwhM3gFcXlFBFXJ0%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a93&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=ugFzCkV6I3OCRrJQ9FnLzeJcn9%2f1IgwVSxXZtTKEjBU%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a71&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=%2fDQsMeL%2be1QWXn5zMIXFzPAgvBWwYO31EAHZI4%2fKwMA%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a40&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=xYg1QT5Z1K3UDUa5E4f3MiijHz2yeKGtMbzEX4WXobA%3d)
> 	at org.apache.reef.wake.impl.PubSubEventHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=PubSubEventHandler.java%3a98&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=JF8vR%2fIt2T%2bs5%2f9FgL5f5IrgJcJXuDh1vUtRHNXBYrE%3d)
> 	at org.apache.reef.wake.time.runtime.RuntimeClock.run(https://na01.safelinks.protection.outlook.com/?url=RuntimeClock.java%3a217&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MLBa2kecAVFmoVqChn1w92VVhjtgJnBDcBQhTz%2f6qD8%3d)
> 	at org.apache.reef.runtime.common.REEFLauncher.main(https://na01.safelinks.protection.outlook.com/?url=REEFLauncher.java%3a175&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=AlftjPC%2bxQOzRwYMjoZYIAAY2TDQ1i9mN%2bX%2b70376cg%3d)
> 	at 
> org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(https://n
> a01.safelinks.protection.outlook.com/?url=YarnBootstrapREEFLauncher.ja
> va%3a65&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7
> d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=djchDQ4%2f
> x2drKLfWPjEmxTpO09Yh9OJ3NfMsUZ7WnQ4%3d)
>
> Apr 12, 2016 4:09:14 PM 
> org.apache.reef.runtime.common.launch.REEFErrorHandler onNext
> SEVERE: Caught an exception from Wake we cannot send upstream because 
> there is no upstream Apr 12, 2016 4:09:14 PM 
> org.apache.reef.runtime.common.REEFLauncher fatal
> SEVERE: Unable to instantiate the clock
> java.lang.NoSuchMethodError: getDefinedRuntimes
> 	at org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(Native Method)
> 	at org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.getClrHandlers(https://na01.safelinks.protection.outlook.com/?url=DriverStartClrHandlersInitializer.java%3a47&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=EH7QKRGkO1xvGCNkUcu9%2bu%2bzBwJgrIPfUKroTxI5uGg%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver.setupBridge(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a196&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=vt%2bK2Q%2bU6fPE2mvUeZjRxFwUQlkCoZdpTBVWgNzApxw%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver.access$1500(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a66&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MvIzspdLxt2LcBoGmrfvag0LgGYjBJ28ZpF2cUH8yaI%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a583&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=uImzpbuk3OVBSyopS1IDuNExUjreb%2b3C0jr3KsilfFo%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a577&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=Ntp4PIjOe1gDSbZE2hsc2znL9EmUwhM3gFcXlFBFXJ0%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a93&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=ugFzCkV6I3OCRrJQ9FnLzeJcn9%2f1IgwVSxXZtTKEjBU%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a71&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=%2fDQsMeL%2be1QWXn5zMIXFzPAgvBWwYO31EAHZI4%2fKwMA%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a40&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=xYg1QT5Z1K3UDUa5E4f3MiijHz2yeKGtMbzEX4WXobA%3d)
> 	at org.apache.reef.wake.impl.PubSubEventHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=PubSubEventHandler.java%3a98&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=JF8vR%2fIt2T%2bs5%2f9FgL5f5IrgJcJXuDh1vUtRHNXBYrE%3d)
> 	at org.apache.reef.wake.time.runtime.RuntimeClock.run(https://na01.safelinks.protection.outlook.com/?url=RuntimeClock.java%3a217&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MLBa2kecAVFmoVqChn1w92VVhjtgJnBDcBQhTz%2f6qD8%3d)
> 	at org.apache.reef.runtime.common.REEFLauncher.main(https://na01.safelinks.protection.outlook.com/?url=REEFLauncher.java%3a175&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=AlftjPC%2bxQOzRwYMjoZYIAAY2TDQ1i9mN%2bX%2b70376cg%3d)
> 	at 
> org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(https://n
> a01.safelinks.protection.outlook.com/?url=YarnBootstrapREEFLauncher.ja
> va%3a65&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7
> d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=djchDQ4%2f
> x2drKLfWPjEmxTpO09Yh9OJ3NfMsUZ7WnQ4%3d)
>
> java.lang.RuntimeException: Unable to instantiate the clock
> 	at org.apache.reef.runtime.common.REEFLauncher.fatal(https://na01.safelinks.protection.outlook.com/?url=REEFLauncher.java%3a120&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=55jXDOtK4b5S9NcLZ9FPvkAbilETLD2k1EdSuVkshdM%3d)
> 	at org.apache.reef.runtime.common.REEFLauncher.main(https://na01.safelinks.protection.outlook.com/?url=REEFLauncher.java%3a179&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=czckdrh6Zka5cVwrNqUM%2bqOCea5RD%2bN3SG4w5M%2fEyZg%3d)
> 	at 
> org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(https://n
> a01.safelinks.protection.outlook.com/?url=YarnBootstrapREEFLauncher.ja
> va%3a65&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7
> d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=djchDQ4%2f
> x2drKLfWPjEmxTpO09Yh9OJ3NfMsUZ7WnQ4%3d)
> Caused by: java.lang.NoSuchMethodError: getDefinedRuntimes
> 	at org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(Native Method)
> 	at org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.getClrHandlers(https://na01.safelinks.protection.outlook.com/?url=DriverStartClrHandlersInitializer.java%3a47&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=EH7QKRGkO1xvGCNkUcu9%2bu%2bzBwJgrIPfUKroTxI5uGg%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver.setupBridge(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a196&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=vt%2bK2Q%2bU6fPE2mvUeZjRxFwUQlkCoZdpTBVWgNzApxw%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver.access$1500(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a66&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MvIzspdLxt2LcBoGmrfvag0LgGYjBJ28ZpF2cUH8yaI%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a583&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=uImzpbuk3OVBSyopS1IDuNExUjreb%2b3C0jr3KsilfFo%3d)
> 	at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=JobDriver.java%3a577&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=Ntp4PIjOe1gDSbZE2hsc2znL9EmUwhM3gFcXlFBFXJ0%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a93&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=ugFzCkV6I3OCRrJQ9FnLzeJcn9%2f1IgwVSxXZtTKEjBU%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a71&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=%2fDQsMeL%2be1QWXn5zMIXFzPAgvBWwYO31EAHZI4%2fKwMA%3d)
> 	at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=DriverStartHandler.java%3a40&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=xYg1QT5Z1K3UDUa5E4f3MiijHz2yeKGtMbzEX4WXobA%3d)
> 	at org.apache.reef.wake.impl.PubSubEventHandler.onNext(https://na01.safelinks.protection.outlook.com/?url=PubSubEventHandler.java%3a98&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=JF8vR%2fIt2T%2bs5%2f9FgL5f5IrgJcJXuDh1vUtRHNXBYrE%3d)
> 	at org.apache.reef.wake.time.runtime.RuntimeClock.run(https://na01.safelinks.protection.outlook.com/?url=RuntimeClock.java%3a217&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MLBa2kecAVFmoVqChn1w92VVhjtgJnBDcBQhTz%2f6qD8%3d)
> 	at org.apache.reef.runtime.common.REEFLauncher.main(https://na01.safelinks.protection.outlook.com/?url=REEFLauncher.java%3a175&data=01%7c01%7cQiuhe.Wang%40microsoft.com%7cc4e4a25f3e82488cf7d308d363296e95%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=AlftjPC%2bxQOzRwYMjoZYIAAY2TDQ1i9mN%2bX%2b70376cg%3d)
> 	... 1 more
>
>
> Thanks
> Dhruv
>
Mime
View raw message