hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akira AJISAKA (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6508) TestNetworkedJob fails intermittently
Date Fri, 23 Oct 2015 10:55:27 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Akira AJISAKA updated MAPREDUCE-6508:
-------------------------------------
    Attachment: MAPREDUCE-6508.00.patch

Attaching a patch to remove test for delegation token (and dead code).
First I thought setting kerberos authentication fixes the problem, however, when I set kerberos
authentication, the MiniMRClientCluster didn't start. In addition, the delegation for RM is
tested by TestRMDelegationTokens and TestTokenClientRMService classes. Therefore I decided
to remove the test code.

> TestNetworkedJob fails intermittently
> -------------------------------------
>
>                 Key: MAPREDUCE-6508
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6508
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>            Reporter: Rohith Sharma K S
>            Assignee: Akira AJISAKA
>         Attachments: MAPREDUCE-6508.00.patch
>
>
> {noformat}
> Running org.apache.hadoop.mapred.TestNetworkedJob
> Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 84.215 sec <<<
FAILURE! - in org.apache.hadoop.mapred.TestNetworkedJob
> testNetworkedJob(org.apache.hadoop.mapred.TestNetworkedJob)  Time elapsed: 31.537 sec
 <<< ERROR!
> java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: java.io.IOException:
Delegation Token can be issued only with kerberos authentication
> 	at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:38)
> 	at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getDelegationToken(ClientRMService.java:1044)
> 	at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getDelegationToken(ApplicationClientProtocolPBServiceImpl.java:325)
> 	at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:483)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:637)
> 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2236)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2232)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1667)
> 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2230)
> Caused by: java.io.IOException: Delegation Token can be issued only with kerberos authentication
> 	at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getDelegationToken(ClientRMService.java:1017)
> 	... 10 more
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1448)
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1379)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230)
> 	at com.sun.proxy.$Proxy84.getDelegationToken(Unknown Source)
> 	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getDelegationToken(ApplicationClientProtocolPBClientImpl.java:339)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:251)
> 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103)
> 	at com.sun.proxy.$Proxy85.getDelegationToken(Unknown Source)
> 	at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getRMDelegationToken(YarnClientImpl.java:541)
> 	at org.apache.hadoop.mapred.ResourceMgrDelegate.getDelegationToken(ResourceMgrDelegate.java:177)
> 	at org.apache.hadoop.mapred.YARNRunner.getDelegationToken(YARNRunner.java:231)
> 	at org.apache.hadoop.mapreduce.Cluster.getDelegationToken(Cluster.java:401)
> 	at org.apache.hadoop.mapred.JobClient$16.run(JobClient.java:1234)
> 	at org.apache.hadoop.mapred.JobClient$16.run(JobClient.java:1231)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1667)
> 	at org.apache.hadoop.mapred.JobClient.getDelegationToken(JobClient.java:1230)
> 	at org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob(TestNetworkedJob.java:260)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message