reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mariia Mykhailova <mamyk...@microsoft.com>
Subject RE: REEF.NET test failures with current master
Date Mon, 04 Apr 2016 22:32:31 GMT
I see these errors from time to time when testing in Visual Studio. Let me check how my command
line test behaves. Do you see this in VS only or in command line too?

If we review and merge my PR for REEF-1311, we'll get one more data point all the time, as
these tests are executed by AppVeyor (and it doesn't seem to hit these issues).

-Mariia

-----Original Message-----
From: Dhruv Mahajan [mailto:dhruv.mahajan@gmail.com] 
Sent: Monday, April 4, 2016 3:27 PM
To: dev@reef.apache.org
Subject: Re: REEF.NET test failures with current master

I checked in morning...did not hit these issues.

On Mon, Apr 4, 2016 at 3:11 PM, Markus Weimer <markus@weimo.de> wrote:

> Hi,
>
> I am seeing some test failures when testing the current `master` of 
> REEF.NET. All of these failures seem related to file access and 
> permissions (see below), which in turn could be caused by 
> synchronization issues between the tests.
>
> Hence, I followed Mariia's advise[0] and set the number of parallel 
> tests to 1. However, that didn't change anything.
>
> Any advise? Am I the only one hitting these issues?
>
> Thanks,
>
> Markus
>
>
>
> [0]: https://github.com/apache/reef/pull/896#issuecomment-205486792
>
>
> ---
>
>
> `TestGeneratingDriverConfigFileWithoutNameServer` fails with:
>
> ```
> Test Name:
> Org.Apache.REEF.Tests.Utility.TestDriverConfigGenerator.TestGenerating
> DriverConfigFileWithoutNameServer
> Test FullName:
> Org.Apache.REEF.Tests.Utility.TestDriverConfigGenerator.TestGenerating
> DriverConfigFileWithoutNameServer
> Test Source:
> C:\src\reef\lang\cs\Org.Apache.REEF.Tests\Utility\TestDriverConfigGene
> rator.cs
> : line 76
> Test Outcome:   Failed
> Test Duration:  0:00:00.242
>
> Result StackTrace:
> at
> Org.Apache.REEF.Driver.Bridge.ClrClientHelper.ExtractConfigfileFromJar
> (String reefJar, IList`1 configFiles, String dropFolder) in 
> C:\src\reef\lang\cs\Org.Apache.REEF.Driver\Bridge\ClrClientHelper.cs:line 60
>    at
> Org.Apache.REEF.Driver.DriverConfigGenerator.ExtractConfigFromJar(Stri
> ng
> jarfileFolder) in
> C:\src\reef\lang\cs\Org.Apache.REEF.Driver\DriverConfigGenerator.cs:line 154
>    at
> Org.Apache.REEF.Driver.DriverConfigGenerator.DriverConfigurationBuilde
> r(DriverConfigurationSettings
> driverConfigurationSettings) in
> C:\src\reef\lang\cs\Org.Apache.REEF.Driver\DriverConfigGenerator.cs:line 51
>    at
> Org.Apache.REEF.Tests.Utility.TestDriverConfigGenerator.TestGenerating
> DriverConfigFileWithoutNameServer()
> in
> C:\src\reef\lang\cs\Org.Apache.REEF.Tests\Utility\TestDriverConfigGene
> rator.cs:line
> 88
> Result Message:
> System.InvalidOperationException : Failed to extract files from jar 
> file with stdout :and stderr:java.util.zip.ZipError: jzentry == 0,  
> jzfile = 639209248,  total = 6070,  name = 
> .\reef-bridge-java-0.15.0-SNAPSHOT-shaded.jar,
>  i = 916,
>  message = null
>         at java.util.zip.ZipFile$ZipEntryIterator.next(https://na01.safelinks.protection.outlook.com/?url=ZipFile.java%3a520&data=01%7c01%7cmamykhai%40microsoft.com%7c154d81be238440be4c8b08d35cd82f9f%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=hVa0os3NxxPr34wsLg4LqcUDfW9mn0o0qrz0LRyFJoA%3d)
>         at
> java.util.zip.ZipFile$ZipEntryIterator.nextElement(https://na01.safelinks.protection.outlook.com/?url=ZipFile.java%3a500&data=01%7c01%7cmamykhai%40microsoft.com%7c154d81be238440be4c8b08d35cd82f9f%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=CagkGoqV9LT4HwvpD%2fnL%2be7BFm%2fg40WMxV03KFhSFgk%3d)
>         at
> java.util.zip.ZipFile$ZipEntryIterator.nextElement(https://na01.safelinks.protection.outlook.com/?url=ZipFile.java%3a481&data=01%7c01%7cmamykhai%40microsoft.com%7c154d81be238440be4c8b08d35cd82f9f%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=SzXqnQ8ZAlEEwFhFxbpYk6FcIiblhdACH%2fyG1SdJ8Uc%3d)
>         at sun.tools.jar.Main.extract(https://na01.safelinks.protection.outlook.com/?url=Main.java%3a960&data=01%7c01%7cmamykhai%40microsoft.com%7c154d81be238440be4c8b08d35cd82f9f%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=74OzAhf2TmOOOortCq%2f5Lb%2fx19Fo%2fydgPzyQA4w9hFg%3d)
>         at sun.tools.jar.Main.run(https://na01.safelinks.protection.outlook.com/?url=Main.java%3a303&data=01%7c01%7cmamykhai%40microsoft.com%7c154d81be238440be4c8b08d35cd82f9f%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=3SaaxK9RzXs4wL5MA5jCsC97HN76BbxUXfpmvdWaoc0%3d)
>         at 
> sun.tools.jar.Main.main(https://na01.safelinks.protection.outlook.com/
> ?url=Main.java%3a1233&data=01%7c01%7cmamykhai%40microsoft.com%7c154d81
> be238440be4c8b08d35cd82f9f%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdat
> a=eO4Zoq5t4KP8Lwwobq90PyH4F0z5iUC8qGsOsAitVWc%3d)
>
> ```
>
> `TestDosomethingOnContextStartOnLocalRuntime` fails with:
>
> ```
> Test Name:
> Org.Apache.REEF.Tests.Functional.FaultTolerant.TestContextStart.TestDo
> somethingOnContextStartOnLocalRuntime
> Test FullName:
> Org.Apache.REEF.Tests.Functional.FaultTolerant.TestContextStart.TestDo
> somethingOnContextStartOnLocalRuntime
> Test Source:
> C:\src\reef\lang\cs\Org.Apache.REEF.Tests\Functional\FaultTolerant\Tes
> tContextStart.cs
> : line 50
> Test Outcome:   Failed
> Test Duration:  0:00:01
>
> Result StackTrace:
> at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
>    at System.IO.FileStream.Init(String path, FileMode mode, FileAccess 
> access, Int32 rights, Boolean useRights, FileShare share, Int32 
> bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String 
> msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)
>    at System.IO.FileStream..ctor(String path, FileMode mode, 
> FileAccess access, FileShare share, Int32 bufferSize, FileOptions 
> options, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)
>    at System.IO.File.InternalWriteAllBytes(String path, Byte[] bytes, 
> Boolean checkHost)
>    at
> Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper.CreateDefa
> ultFolderStructure(AppParameters appParameters, String 
> driverFolderPath) in 
> C:\src\reef\lang\cs\Org.Apache.REEF.Client\Common\DriverFolderPreparat
> ionHelper.cs:line
> 134
>    at
> Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper.PrepareDri
> verFolder(AppParameters appParameters, String driverFolderPath) in 
> C:\src\reef\lang\cs\Org.Apache.REEF.Client\Common\DriverFolderPreparat
> ionHelper.cs:line
> 79
>    at
> Org.Apache.REEF.Client.Local.LocalClient.PrepareDriverFolder(JobReques
> t
> jobRequest) in
> C:\src\reef\lang\cs\Org.Apache.REEF.Client\Local\LocalClient.cs:line 153
>    at
> Org.Apache.REEF.Client.Local.LocalClient.SubmitAndGetJobStatus(JobRequ
> est
> jobRequest) in
> C:\src\reef\lang\cs\Org.Apache.REEF.Client\Local\LocalClient.cs:line 175
>    at
> Org.Apache.REEF.Tests.Functional.ReefFunctionalTest.TestRun(IConfigura
> tion driverConfig, Type globalAssemblyType, Int32 numberOfEvaluator, 
> String jobIdentifier, String runOnYarn, String runtimeFolder) in 
> C:\src\reef\lang\cs\Org.Apache.REEF.Tests\Functional\ReefFunctionalTes
> t.cs:line
> 346
>    at
> Org.Apache.REEF.Tests.Functional.FaultTolerant.TestContextStart.TestDo
> somethingOnContextStartOnLocalRuntime()
> in
> C:\src\reef\lang\cs\Org.Apache.REEF.Tests\Functional\FaultTolerant\Tes
> tContextStart.cs:line
> 52
> Result Message: System.IO.IOException : The process cannot access the 
> file 'C:\src\reef\lang\cs\bin\x64\Debug\Org.Apache.REEF.Tests\reef-bridge-client-0.15.0-SNAPSHOT-shaded.jar'
> because it is being used by another process.
> ```
>
> and `TestStopTaskOnLocalRuntimeWithNullMessage` fails with:
>
> ```
> Test Name:
> Org.Apache.REEF.Tests.Functional.Bridge.TestCloseTask.TestStopTaskOnLo
> calRuntimeWithNullMessage
> Test FullName:
> Org.Apache.REEF.Tests.Functional.Bridge.TestCloseTask.TestStopTaskOnLo
> calRuntimeWithNullMessage
> Test Source:
> C:\src\reef\lang\cs\Org.Apache.REEF.Tests\Functional\Bridge\TestCloseT
> ask.cs
> : line 116
> Test Outcome:   Failed
> Test Duration:  0:00:14.432
>
> Result StackTrace:
> at System.IO.Directory.DeleteHelper(String fullPath, String userPath, 
> Boolean recursive, Boolean throwOnTopLevelDirectoryNotFound)
>    at System.IO.Directory.Delete(String fullPath, String userPath, 
> Boolean recursive, Boolean checkHost)
>    at 
> Org.Apache.REEF.Tests.Functional.ReefFunctionalTest.CleanUp(String
> testFolder) in
> C:\src\reef\lang\cs\Org.Apache.REEF.Tests\Functional\ReefFunctionalTes
> t.cs:line
> 136
>    at
> Org.Apache.REEF.Tests.Functional.Bridge.TestCloseTask.TestStopTaskOnLo
> calRuntimeWithNullMessage()
> in
> C:\src\reef\lang\cs\Org.Apache.REEF.Tests\Functional\Bridge\TestCloseT
> ask.cs:line
> 124
> Result Message: System.UnauthorizedAccessException : Access to the 
> path 'Org.Apache.REEF.Bridge.exe' is denied.
> ```
>
>
Mime
View raw message