hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stanley shi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5675) krb5.conf is missing in some of the test resource folders
Date Tue, 10 Dec 2013 07:50:09 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stanley shi updated MAPREDUCE-5675:
-----------------------------------

    Description: 
org.apache.hadoop.mapreduce.v2.hs.TestJobHistoryParsing.testPartialJob fail due to some timeout
issue:
{code}
java.lang.Exception: test timed out after 1000 milliseconds
	at java.net.PlainDatagramSocketImpl.receive0(Native Method)
	at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:145)
	at java.net.DatagramSocket.receive(DatagramSocket.java:786)
	at com.sun.jndi.dns.DnsClient.doUdpQuery(DnsClient.java:411)
	at com.sun.jndi.dns.DnsClient.query(DnsClient.java:203)
	at com.sun.jndi.dns.Resolver.query(Resolver.java:81)
	at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
	at com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
	at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
	at com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
	at sun.security.krb5.KrbServiceLocator.getKerberosService(KrbServiceLocator.java:87)
	at sun.security.krb5.Config.checkRealm(Config.java:1265)
	at sun.security.krb5.Config.getRealmFromDNS(Config.java:1238)
	at sun.security.krb5.Config.getDefaultRealm(Config.java:1132)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.hadoop.security.authentication.util.KerberosUtil.getDefaultRealm(KerberosUtil.java:75)
	at org.apache.hadoop.security.authentication.util.KerberosName.<clinit>(KerberosName.java:85)
	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:225)
	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:214)
	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:669)
	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:571)
	at org.apache.hadoop.mapreduce.v2.hs.TestJobHistoryParsing.testPartialJob(TestJobHistoryParsing.java:721)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:62)
{code}
The same error also exist for the test org.apache.hadoop.mapred.TestJobClient.testIsJobDirValid
This is due to the missing of the krb5.conf file in the corresponding test resource folder;

The solution would be copy the krb5.conf file to the corresponding test resource dir:
{code}
cp ./hadoop-common-project/hadoop-common/src/test/resources/krb5.conf hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/resources/
cp ./hadoop-common-project/hadoop-common/src/test/resources/krb5.conf ./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/
{code}

  was:
org.apache.hadoop.mapreduce.v2.hs.TestJobHistoryParsing.testPartialJob fail due to some timeout
issue:
{code}
java.lang.Exception: test timed out after 1000 milliseconds
	at java.net.PlainDatagramSocketImpl.receive0(Native Method)
	at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:145)
	at java.net.DatagramSocket.receive(DatagramSocket.java:786)
	at com.sun.jndi.dns.DnsClient.doUdpQuery(DnsClient.java:411)
	at com.sun.jndi.dns.DnsClient.query(DnsClient.java:203)
	at com.sun.jndi.dns.Resolver.query(Resolver.java:81)
	at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
	at com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
	at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
	at com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
	at sun.security.krb5.KrbServiceLocator.getKerberosService(KrbServiceLocator.java:87)
	at sun.security.krb5.Config.checkRealm(Config.java:1265)
	at sun.security.krb5.Config.getRealmFromDNS(Config.java:1238)
	at sun.security.krb5.Config.getDefaultRealm(Config.java:1132)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.hadoop.security.authentication.util.KerberosUtil.getDefaultRealm(KerberosUtil.java:75)
	at org.apache.hadoop.security.authentication.util.KerberosName.<clinit>(KerberosName.java:85)
	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:225)
	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:214)
	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:669)
	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:571)
	at org.apache.hadoop.mapreduce.v2.hs.TestJobHistoryParsing.testPartialJob(TestJobHistoryParsing.java:721)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:62)
{code}
Actually this is due to the missing of the krb5.conf file in the corresponding test resource
folder; 
The same error also exist for the test org.apache.hadoop.mapred.TestJobClient.testIsJobDirValid
The solution would be copy the krb5.conf file to the corresponding test resource dir:
{code}
cp ./hadoop-common-project/hadoop-common/src/test/resources/krb5.conf hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/resources/
cp ./hadoop-common-project/hadoop-common/src/test/resources/krb5.conf ./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/
{code}


> krb5.conf is missing in some of the test resource folders
> ---------------------------------------------------------
>
>                 Key: MAPREDUCE-5675
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5675
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.2.0
>         Environment: CentOS6.4
> JDK7u15
>            Reporter: stanley shi
>
> org.apache.hadoop.mapreduce.v2.hs.TestJobHistoryParsing.testPartialJob fail due to some
timeout issue:
> {code}
> java.lang.Exception: test timed out after 1000 milliseconds
> 	at java.net.PlainDatagramSocketImpl.receive0(Native Method)
> 	at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:145)
> 	at java.net.DatagramSocket.receive(DatagramSocket.java:786)
> 	at com.sun.jndi.dns.DnsClient.doUdpQuery(DnsClient.java:411)
> 	at com.sun.jndi.dns.DnsClient.query(DnsClient.java:203)
> 	at com.sun.jndi.dns.Resolver.query(Resolver.java:81)
> 	at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
> 	at com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
> 	at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
> 	at com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
> 	at sun.security.krb5.KrbServiceLocator.getKerberosService(KrbServiceLocator.java:87)
> 	at sun.security.krb5.Config.checkRealm(Config.java:1265)
> 	at sun.security.krb5.Config.getRealmFromDNS(Config.java:1238)
> 	at sun.security.krb5.Config.getDefaultRealm(Config.java:1132)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at org.apache.hadoop.security.authentication.util.KerberosUtil.getDefaultRealm(KerberosUtil.java:75)
> 	at org.apache.hadoop.security.authentication.util.KerberosName.<clinit>(KerberosName.java:85)
> 	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:225)
> 	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:214)
> 	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:669)
> 	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:571)
> 	at org.apache.hadoop.mapreduce.v2.hs.TestJobHistoryParsing.testPartialJob(TestJobHistoryParsing.java:721)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
> 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
> 	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:62)
> {code}
> The same error also exist for the test org.apache.hadoop.mapred.TestJobClient.testIsJobDirValid
> This is due to the missing of the krb5.conf file in the corresponding test resource folder;

> The solution would be copy the krb5.conf file to the corresponding test resource dir:
> {code}
> cp ./hadoop-common-project/hadoop-common/src/test/resources/krb5.conf hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/resources/
> cp ./hadoop-common-project/hadoop-common/src/test/resources/krb5.conf ./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/
> {code}



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message