hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5859) TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails
Date Tue, 08 Nov 2016 21:58:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648913#comment-15648913
] 

Jason Lowe commented on YARN-5859:
----------------------------------

The test output:
{noformat}
2016-11-07 20:00:01,393 INFO  [Thread-275] event.AsyncDispatcher (AsyncDispatcher.java:register(213))
- Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType
for class org.apache.hadoop.yarn.event.EventHandler$$EnhancerByMockitoWithCGLIB$$f197772f
2016-11-07 20:00:01,394 INFO  [Thread-275] event.AsyncDispatcher (AsyncDispatcher.java:register(213))
- Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType
for class org.apache.hadoop.yarn.event.EventHandler$$EnhancerByMockitoWithCGLIB$$f197772f
2016-11-07 20:00:01,403 INFO  [Thread-275] nodemanager.DirectoryCollection (DirectoryCollection.java:<init>(185))
- Disk Validator: yarn.nodemanager.disk-validator is loaded.
2016-11-07 20:00:01,411 INFO  [Thread-275] nodemanager.DirectoryCollection (DirectoryCollection.java:<init>(185))
- Disk Validator: yarn.nodemanager.disk-validator is loaded.
2016-11-07 20:00:01,554 INFO  [Thread-275] event.AsyncDispatcher (AsyncDispatcher.java:register(213))
- Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType
for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$$EnhancerByMockitoWithCGLIB$$9a46a6a4
2016-11-07 20:00:01,555 INFO  [Thread-275] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(232))
- per directory file limit = 8192
2016-11-07 20:00:01,596 INFO  [Thread-275] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(260))
- Disk Validator: yarn.nodemanager.disk-validator is loaded.
2016-11-07 20:00:01,598 INFO  [Thread-275] event.AsyncDispatcher (AsyncDispatcher.java:register(213))
- Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType
for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2016-11-07 20:00:01,612 INFO  [AsyncDispatcher event handler] localizer.ResourceLocalizationService
(ResourceLocalizationService.java:addResource(845)) - Downloading public rsrc:{ /tmp, 123,
FILE,  }
{noformat}

I'm guessing the 200 millisecond timeout is too short sometimes if the unit test is running
in a slow VM or there are other performance hiccups (GC, etc.).

> TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes
fails
> ---------------------------------------------------------------------------------------------
>
>                 Key: YARN-5859
>                 URL: https://issues.apache.org/jira/browse/YARN-5859
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: test
>            Reporter: Jason Lowe
>
> Saw the following test failure:
> {noformat}
> Running org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService
> Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 12.011 sec <<<
FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService
> testParallelDownloadAttemptsForPublicResource(org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService)
 Time elapsed: 0.586 sec  <<< FAILURE!
> java.lang.AssertionError: null
> 	at org.junit.Assert.fail(Assert.java:86)
> 	at org.junit.Assert.assertTrue(Assert.java:41)
> 	at org.junit.Assert.assertTrue(Assert.java:52)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testParallelDownloadAttemptsForPublicResource(TestResourceLocalizationService.java:2108)
> {noformat}
> The assert occurred at this place in the code:
> {code}
>       // Waiting for download to start.
>       Assert.assertTrue(waitForPublicDownloadToStart(spyService, 1, 200));
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message