reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Boris Shulman <shulm...@gmail.com>
Subject Re: Issues with running on yarn
Date Wed, 13 Apr 2016 02:26:59 GMT
I wonder why our functional tests run in a different way from the examples.
Examples fail (even HelloReef on local) while all tests pass.

On Tue, Apr 12, 2016 at 7:00 PM, Boris Shulman <shulmanb@gmail.com> wrote:

> Also when I ran clean build I am getting:
>
> "C:\work\GitHub\incubator-reef\lang\cs\Org.Apache.REEF.sln" (default
> target) (1) ->
> "C:\work\GitHub\incubator-reef\lang\cs\Org.Apache.REEF.Tang.Tests\Org.Apache.REEF.Tang.Tests.csproj"
> (default target) (7) ->
> (RestorePackages target) ->
>   C:\work\GitHub\incubator-reef\lang\cs\.nuget\NuGet.targets(135,9): error
> : Access to the path
> 'C:\work\GitHub\incubator-reef\lang\cs\packages\xunit.extensibility.core.2.1.0\lib\portable-net45+win8+wp8+wpa81\xunit.core.xml'
> is denied. [C:\work\GitHub\incubator-reef\lan
> g\cs\Org.Apache.REEF.Tang.Tests\Org.Apache.REEF.Tang.Tests.csproj]
>   C:\work\GitHub\incubator-reef\lang\cs\.nuget\NuGet.targets(135,9): error
> MSB3073: The command
> ""C:\work\GitHub\incubator-reef\lang\cs\.nuget\NuGet.exe" install
> "C:\work\GitHub\incubator-reef\lang\cs\Org.Apache.REEF.Tang.Tests\packages.config"
> -source ""  -NonInteracti
> ve -RequireConsent -solutionDir "C:\work\GitHub\incubator-reef\lang\cs\ ""
> exited with code 1.
> [C:\work\GitHub\incubator-reef\lang\cs\Org.Apache.REEF.Tang.Tests\Org.Apache.REEF.Tang.Tests.csproj]
>
>
> Second build succeed, so maybe dlls are not produced on first build.
>
> All functional tests pass after second build. Examples still failed. Will
> fix that tonight.
>
> On Tue, Apr 12, 2016 at 6:07 PM, Boris Shulman <shulmanb@gmail.com> wrote:
>
>> This is strange. Both me and Markus tested that. Are y sure u built
>> bridge code? This method was added there.
>> ------------------------------
>> From: Julia Wang (QIUHE) <Qiuhe.Wang@microsoft.com>
>> Sent: ‎4/‎12/‎2016 6:03 PM
>> To: dev@reef.apache.org
>> Subject: RE: Issues with running on yarn
>>
>> After a clean build, I got same error. Pick up any REEF functional test,
>> it will fail at beginning of Driver start.
>>
>> ____________________________
>> SEVERE: Unable to instantiate the clock
>> java.lang.NoSuchMethodError: getDefinedRuntimes
>> at
>> org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(Native
>> Method)
>> at
>> org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.getClrHandlers(DriverStartClrHandlersInitializer.java:47)
>> at
>> org.apache.reef.javabridge.generic.JobDriver.setupBridge(JobDriver.java:196)
>> at
>> org.apache.reef.javabridge.generic.JobDriver.access$1500(JobDriver.java:66)
>> at
>> org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:583)
>> at
>> org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobDriver.java:577)
>> at
>> org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(DriverStartHandler.java:93)
>> at
>> org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:71)
>> at
>> org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(DriverStartHandler.java:40)
>> at
>> org.apache.reef.wake.impl.PubSubEventHandler.onNext(PubSubEventHandler.java:98)
>> at
>> org.apache.reef.wake.time.runtime.RuntimeClock.run(RuntimeClock.java:217)
>> at org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:175)
>> __________________
>> Option 0 [-XX:PermSize=128m]
>> Option 1 [-XX:MaxPermSize=128m]
>> Option 2 [-Xmx512m]
>> Option 3
>> [-Djava.class.path=;C:\reef\ReefApache\reef1\lang\cs\bin\x64\Debug\Org.Apache.REEF.Tests\REEF_LOCAL_RUNTIME6ae4196f\reef-ContextStartDriver-20160412174234260\driver\reef\global\reef-bridge-client-0.15.0-SNAPSHOT-shaded.jar;C:\reef\ReefApache\reef1\lang\cs\bin\x64\Debug\Org.Apache.REEF.Tests\.\reef-bridge-client-0.15.0-SNAPSHOT-shaded.jar]
>> Option 4 [-Dproc_reef]
>> Found class 'org/apache/reef/javabridge/NativeInterop'<C++>InteropUtil
>> Information: 0 : 2016-04-12T17:43:23.0956095-07:00 0001
>> INFO:
>> +Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler
>> <C++> Start: 0 : 2016-04-12T17:43:23.1036094-07:00 0001
>> START: EvaluatorRequestorClr2Java::EvaluatorRequestorClr2Java
>> <C++> Stop: 0 : 2016-04-12T17:43:23.1041093-07:00 0001
>> EXIT: EvaluatorRequestorClr2Java::EvaluatorRequestorClr2Java
>> <C++> Start: 0 : 2016-04-12T17:43:23.1526168-07:00 0001
>> START: EvaluatorRequestorClr2Java::GetDefinedRuntimes
>> jmidGetDefinedRuntimes is NULL
>> <C++>InteropUtil Error: 0 : 2016-04-12T17:43:23.4991608-07:00 0001
>> ERROR: Exceptions in
>> Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandlerencountered
>> error [System.ArgumentNullException: Buffer cannot be null.
>> Parameter name: buffer
>>    at System.IO.MemoryStream..ctor(Byte[] buffer, Boolean writable)
>>    at
>> Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBytes(Byte[]
>> serializedData)
>>    at
>> Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEvaluatorRequestorClr2Java
>> clr2Java)
>>    at
>> Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemStartHandler_OnStart(DateTime
>> startTime, String httpServerPort, IEvaluatorRequestorClr2Java
>> evaluatorRequestorClr2Java)
>>    at
>> Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler(JNIEnv_*
>> env, _jclass* jclassx, _jstring* dateTimeString, _jstring* httpServerPort,
>> _jobject* jbridgeHandlerManager, _jobject* jevaluatorRequestorBridge)] with
>> mesage [Buffer cannot be null.
>> Parameter name: buffer] and stack trace [   at
>> System.IO.MemoryStream..ctor(Byte[] buffer, Boolean writable)
>>    at
>> Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBytes(Byte[]
>> serializedData)
>>    at
>> Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEvaluatorRequestorClr2Java
>> clr2Java)
>>    at
>> Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemStartHandler_OnStart(DateTime
>> startTime, String httpServerPort, IEvaluatorRequestorClr2Java
>> evaluatorRequestorClr2Java)
>>    at
>> Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartHandler(JNIEnv_*
>> env, _jclass* jclassx, _jstring* dateTimeString, _jstring* httpServerPort,
>> _jobject* jbridgeHandlerManager, _jobject* jevaluatorRequestorBridge)]
>>
>> -----Original Message-----
>> From: Markus Weimer [mailto:markus@weimo.de]
>> Sent: Tuesday, April 12, 2016 5:22 PM
>> To: dev@reef.apache.org
>> Subject: Re: Issues with running on yarn
>>
>> On 2016-04-12 16:50, Dhruv Mahajan wrote:
>> > I see very wierd....Lemme again try rerunning...I was doing:
>> >
>> > mvn clean install -DskipTests followed by compiling C# code. Lemme
>> retry.
>>
>> I am very paranoid when it comes to clean builds and execute the
>> following as a clean in powershell:
>>
>> ```
>> function Clean-REEF{
>>    Invoke-Expression 'msbuild
>> $REEFSourcePath\lang\cs\Org.Apache.REEF.sln /m /nr:false /t:Clean'
>>    # Perform some more deletes because I don't trust MSBuild
>>    Stop-Process -Force -Name MSBuild
>>    Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter obj
>>              | Remove-Item -Recurse
>>    Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter bin
>>              | Remove-Item -Recurse
>>    Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter target
>>              | Remove-Item -Recurse
>>    Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter
>> REEF_LOCAL_RUNTIME | Remove-Item -Recurse
>>    Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter
>> TestResults        | Remove-Item -Recurse
>>    Get-ChildItem -Path $REEFSourcePath\lang\cs\ -Recurse -Filter
>> packages           | Remove-Item -Recurse
>> }
>> ```
>>
>> This deletes everything, including the downloaded NuGets.
>>
>> Markus
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message