hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-857) Localization failures should be available in container diagnostics
Date Wed, 09 Sep 2015 17:38:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737263#comment-14737263
] 

Steve Loughran commented on YARN-857:
-------------------------------------


Two tests failed

h3. TestContainerLocalizer.testContainerLocalizerMainFailure
{code}
org.mockito.exceptions.misusing.NullInsteadOfMockException: 
Argument passed to when() is null!
Example of correct stubbing:
    doThrow(new RuntimeException()).when(mock).someMethod();
Also, if you use @Mock annotation don't miss initMocks()
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestContainerLocalizer.setupContainerLocalizerForTest(TestContainerLocalizer.java:258)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestContainerLocalizer.testContainerLocalizerMainFailure(TestContainerLocalizer.java:218)
{code}

h3. TestDefaultContainerExecutor.testStartLocalizer

{code}
java.lang.AssertionError: StartLocalizer failed to copy token file java.io.IOException: Localizer
failed to run successfully, exitCode=-1
	at org.junit.Assert.fail(Assert.java:88)
	at org.apache.hadoop.yarn.server.nodemanager.TestDefaultContainerExecutor.testStartLocalizer(TestDefaultContainerExecutor.java:438)

RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
java.net.ConnectException: Call From asf906.gq1.ygridcore.net/67.195.81.150 to 0.0.0.0:8040
failed on connection exception: java.net.ConnectException: Connection refused; For more details
see:  http://wiki.apache.org/hadoop/ConnectionRefused
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
	at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792)
	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:732)
	at org.apache.hadoop.ipc.Client.call(Client.java:1449)
	at org.apache.hadoop.ipc.Client.call(Client.java:1376)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
	at com.sun.proxy.$Proxy11.heartbeat(Unknown Source)
	at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.client.LocalizationProtocolPBClientImpl.heartbeat(LocalizationProtocolPBClientImpl.java:62)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:236)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:170)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:138)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$11700655.CGLIB$startLocalizer$6(<generated>)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$11700655$$FastClassByMockitoWithCGLIB$$5eadd005.invoke(<generated>)
	at org.mockito.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:216)
	at org.mockito.internal.creation.AbstractMockitoMethodProxy.invokeSuper(AbstractMockitoMethodProxy.java:10)
	at org.mockito.internal.invocation.realmethod.CGLIBProxyRealMethod.invoke(CGLIBProxyRealMethod.java:22)
	at org.mockito.internal.invocation.realmethod.FilteredCGLIBProxyRealMethod.invoke(FilteredCGLIBProxyRealMethod.java:27)
	at org.mockito.internal.invocation.Invocation.callRealMethod(Invocation.java:211)
	at org.mockito.internal.stubbing.answers.CallsRealMethods.answer(CallsRealMethods.java:36)
	at org.mockito.internal.MockHandler.handle(MockHandler.java:99)
	at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$11700655.startLocalizer(<generated>)
	at org.apache.hadoop.yarn.server.nodemanager.TestDefaultContainerExecutor.testStartLocalizer(TestDefaultContainerExecutor.java:429)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
{code}


-this one implies that the mockito object is still trying to connect to something, but as
that something has 0.0.0.0 as an address, it fails

> Localization failures should be available in container diagnostics
> ------------------------------------------------------------------
>
>                 Key: YARN-857
>                 URL: https://issues.apache.org/jira/browse/YARN-857
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Hitesh Shah
>            Assignee: Vinod Kumar Vavilapalli
>            Priority: Critical
>         Attachments: YARN-857.1.patch, YARN-857.2.patch
>
>
>         at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.client.LocalizationProtocolPBClientImpl.heartbeat(LocalizationProtocolPBClientImpl.java:62)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:235)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:169)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:106)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:978)
> Traced this down to DefaultExecutor which does not look at the exit code for the localizer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message