From yarn-issues-return-155590-apmail-hadoop-yarn-issues-archive=hadoop.apache.org@hadoop.apache.org Thu Oct 18 01:02:04 2018 Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C122518209 for ; Thu, 18 Oct 2018 01:02:04 +0000 (UTC) Received: (qmail 32728 invoked by uid 500); 18 Oct 2018 01:02:04 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 32675 invoked by uid 500); 18 Oct 2018 01:02:04 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 32664 invoked by uid 99); 18 Oct 2018 01:02:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Oct 2018 01:02:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D677A1822BE for ; Thu, 18 Oct 2018 01:02:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.501 X-Spam-Level: X-Spam-Status: No, score=-109.501 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 2xemd8ua52ba for ; Thu, 18 Oct 2018 01:02:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 0FED95F530 for ; Thu, 18 Oct 2018 01:02:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 440F0E002F for ; Thu, 18 Oct 2018 01:02:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 0F7042124D for ; Thu, 18 Oct 2018 01:02:00 +0000 (UTC) Date: Thu, 18 Oct 2018 01:02:00 +0000 (UTC) From: "Eric Yang (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-8899) TestCleanupAfterKIll is failing due to unsatisfied dependencies MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-8899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654495#comment-16654495 ] Eric Yang commented on YARN-8899: --------------------------------- I have the same workaround in local testing but this means any project that make use of mini yarn cluster will require to include those as test dependencies. This means hadoop-yarn-server-resourcemanager, and hadoop-yarn-server-nodemanager needs to have the same work around. This doesn't not appear to be the right solution. Hadoop-yarn-server-web-proxy jar file is brought into the classpath when unit test is ran, but not it's dependencies, this could be the reason that even after including bouncycastle in minicluster jar, this error doesn't go away because the relocation of reference was not triggering code path in minicluster, instead depend on hadoop-yarn-server-web-proxy.jar. > TestCleanupAfterKIll is failing due to unsatisfied dependencies > --------------------------------------------------------------- > > Key: YARN-8899 > URL: https://issues.apache.org/jira/browse/YARN-8899 > Project: Hadoop YARN > Issue Type: Improvement > Components: yarn-native-services > Affects Versions: 3.3.0 > Reporter: Eric Yang > Priority: Major > > BouncyCastle upgrade cause unit test to fail due to unsatisfied transitive dependencies. > It looks like the new version of bcprov-jdk15on bring in a new dependency bcpkix-jdk15on. Minicluster does not have bcpkix-jdk15on dependency and cause unit test that depends on minicluster to fail. > {code} > [ERROR] testRegistryCleanedOnLifetimeExceeded(org.apache.hadoop.yarn.service.TestCleanupAfterKill) Time elapsed: 2.709 s <<< ERROR! > java.lang.NoClassDefFoundError: org/bouncycastle/operator/OperatorCreationException > at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:836) > at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1256) > at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:324) > at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at org.apache.hadoop.yarn.server.MiniYARNCluster.initResourceManager(MiniYARNCluster.java:348) > at org.apache.hadoop.yarn.server.MiniYARNCluster.access$200(MiniYARNCluster.java:128) > at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceInit(MiniYARNCluster.java:497) > at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at org.apache.hadoop.yarn.server.MiniYARNCluster.serviceInit(MiniYARNCluster.java:316) > at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at org.apache.hadoop.yarn.service.ServiceTestUtils.setupInternal(ServiceTestUtils.java:251) > at org.apache.hadoop.yarn.service.TestCleanupAfterKill.testRegistryCleanedOnLifetimeExceeded(TestCleanupAfterKill.java:66) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) > Caused by: java.lang.ClassNotFoundException: org.bouncycastle.operator.OperatorCreationException > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 23 more > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: yarn-issues-help@hadoop.apache.org