Return-Path: <yarn-issues-return-100856-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org>
X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io
Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io
Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183])
	by cust-asf2.ponee.io (Postfix) with ESMTP id B1493200BE0
	for <archive-asf-public-internal@cust-asf2.ponee.io>; Tue,  8 Nov 2016 22:59:00 +0100 (CET)
Received: by cust-asf.ponee.io (Postfix)
	id AEE6C160B15; Tue,  8 Nov 2016 21:59:00 +0000 (UTC)
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by cust-asf.ponee.io (Postfix) with SMTP id 04CFF160B0C
	for <archive-asf-public@cust-asf.ponee.io>; Tue,  8 Nov 2016 22:58:59 +0100 (CET)
Received: (qmail 32278 invoked by uid 500); 8 Nov 2016 21:58:59 -0000
Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:yarn-issues-help@hadoop.apache.org>
List-Unsubscribe: <mailto:yarn-issues-unsubscribe@hadoop.apache.org>
List-Post: <mailto:yarn-issues@hadoop.apache.org>
List-Id: <yarn-issues.hadoop.apache.org>
Delivered-To: mailing list yarn-issues@hadoop.apache.org
Received: (qmail 31956 invoked by uid 99); 8 Nov 2016 21:58:58 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Nov 2016 21:58:58 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id B936D2C1F5A
	for <yarn-issues@hadoop.apache.org>; Tue,  8 Nov 2016 21:58:58 +0000 (UTC)
Date: Tue, 8 Nov 2016 21:58:58 +0000 (UTC)
From: "Jason Lowe (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13019379.1478642109000.226110.1478642338755@Atlassian.JIRA>
In-Reply-To: <JIRA.13019379.1478642109000@Atlassian.JIRA>
References: <JIRA.13019379.1478642109000@Atlassian.JIRA> <JIRA.13019379.1478642109918@arcas>
Subject: [jira] [Commented] (YARN-5859)
 TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource
 sometimes fails
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
archived-at: Tue, 08 Nov 2016 21:59:00 -0000


    [ https://issues.apache.org/jira/browse/YARN-5859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648913#comment-15648913 ] 

Jason Lowe commented on YARN-5859:
----------------------------------

The test output:
{noformat}
2016-11-07 20:00:01,393 INFO  [Thread-275] event.AsyncDispatcher (AsyncDispatcher.java:register(213)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.event.EventHandler$$EnhancerByMockitoWithCGLIB$$f197772f
2016-11-07 20:00:01,394 INFO  [Thread-275] event.AsyncDispatcher (AsyncDispatcher.java:register(213)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.event.EventHandler$$EnhancerByMockitoWithCGLIB$$f197772f
2016-11-07 20:00:01,403 INFO  [Thread-275] nodemanager.DirectoryCollection (DirectoryCollection.java:<init>(185)) - Disk Validator: yarn.nodemanager.disk-validator is loaded.
2016-11-07 20:00:01,411 INFO  [Thread-275] nodemanager.DirectoryCollection (DirectoryCollection.java:<init>(185)) - Disk Validator: yarn.nodemanager.disk-validator is loaded.
2016-11-07 20:00:01,554 INFO  [Thread-275] event.AsyncDispatcher (AsyncDispatcher.java:register(213)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$$EnhancerByMockitoWithCGLIB$$9a46a6a4
2016-11-07 20:00:01,555 INFO  [Thread-275] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(232)) - per directory file limit = 8192
2016-11-07 20:00:01,596 INFO  [Thread-275] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(260)) - Disk Validator: yarn.nodemanager.disk-validator is loaded.
2016-11-07 20:00:01,598 INFO  [Thread-275] event.AsyncDispatcher (AsyncDispatcher.java:register(213)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2016-11-07 20:00:01,612 INFO  [AsyncDispatcher event handler] localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(845)) - Downloading public rsrc:{ /tmp, 123, FILE,  }
{noformat}

I'm guessing the 200 millisecond timeout is too short sometimes if the unit test is running in a slow VM or there are other performance hiccups (GC, etc.).

> TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails
> ---------------------------------------------------------------------------------------------
>
>                 Key: YARN-5859
>                 URL: https://issues.apache.org/jira/browse/YARN-5859
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: test
>            Reporter: Jason Lowe
>
> Saw the following test failure:
> {noformat}
> Running org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService
> Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 12.011 sec <<< FAILURE! - in org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService
> testParallelDownloadAttemptsForPublicResource(org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService)  Time elapsed: 0.586 sec  <<< FAILURE!
> java.lang.AssertionError: null
> 	at org.junit.Assert.fail(Assert.java:86)
> 	at org.junit.Assert.assertTrue(Assert.java:41)
> 	at org.junit.Assert.assertTrue(Assert.java:52)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.testParallelDownloadAttemptsForPublicResource(TestResourceLocalizationService.java:2108)
> {noformat}
> The assert occurred at this place in the code:
> {code}
>       // Waiting for download to start.
>       Assert.assertTrue(waitForPublicDownloadToStart(spyService, 1, 200));
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org