hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3431) NPE in Resource Manager shutdown
Date Fri, 18 Nov 2011 16:26:51 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152948#comment-13152948
] 

Steve Loughran commented on MAPREDUCE-3431:
-------------------------------------------

full exec log
{code}
homemac:current slo$ yarn resourcemanager
/Library/Java/Home/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.log.dir=/Users/slo/Hadoop/versions/current/bin/../logs
-Dyarn.log.dir=/Users/slo/Hadoop/versions/current/bin/../logs -Dhadoop.log.file=yarn.log -Dyarn.log.file=yarn.log
-Dyarn.home.dir= -Dyarn.id.str= -Dhadoop.root.logger=INFO,console -Dyarn.root.logger=INFO,console
-Dyarn.policy.file=hadoop-policy.xml -Dhadoop.log.dir=/Users/slo/Hadoop/versions/current/bin/../logs
-Dyarn.log.dir=/Users/slo/Hadoop/versions/current/bin/../logs -Dhadoop.log.file=yarn.log -Dyarn.log.file=yarn.log
-Dyarn.home.dir=/Users/slo/Hadoop/versions/current/bin/.. -Dhadoop.root.logger=INFO,console
-Dyarn.root.logger=INFO,console -classpath /Users/slo/Hadoop/versions/current/etc/hadoop/:/Users/slo/Hadoop/versions/current/conf::/Library/Java/Home/lib/tools.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/*:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/*:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/*:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/*:/Users/slo/Hadoop/versions/current/bin/../modules/*:/Users/slo/Hadoop/versions/current/bin/../lib/*:/Users/slo/Hadoop/versions/current/conf/rm-config/log4j.properties
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
11/11/18 16:21:57 INFO resourcemanager.ResourceManager: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting ResourceManager
STARTUP_MSG:   host = homemac/192.168.1.88
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.23.0
STARTUP_MSG:   classpath = /Users/slo/Hadoop/versions/current/etc/hadoop/:/Users/slo/Hadoop/versions/current/conf::/Library/Java/Home/lib/tools.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/hadoop-common-0.23.0-sources.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/hadoop-common-0.23.0-test-sources.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/hadoop-common-0.23.0-tests.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/hadoop-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/activation-1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/asm-3.2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/aspectjrt-1.6.5.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/avro-1.5.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/avro-ipc-1.5.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-cli-1.2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-codec-1.4.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-collections-3.2.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-configuration-1.6.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-digester-1.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-el-1.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-httpclient-3.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-lang-2.5.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-logging-1.1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-logging-api-1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-math-2.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-net-1.4.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/core-3.1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/guava-r09.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-auth-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-mapreduce-client-app-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-mapreduce-client-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-mapreduce-client-core-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-mapreduce-client-jobclient-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-yarn-api-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-yarn-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-yarn-server-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hsqldb-1.8.0.7.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jackson-core-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jackson-jaxrs-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jackson-mapper-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jackson-xc-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jersey-core-1.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jersey-json-1.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jersey-server-1.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jets3t-0.6.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jettison-1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jetty-6.1.26.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jetty-util-6.1.26.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jsp-api-2.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/kfs-0.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/log4j-1.2.15.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/netty-3.2.4.Final.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/oro-2.0.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/paranamer-2.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/servlet-api-2.5.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/slf4j-api-1.5.11.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/slf4j-log4j12-1.5.11.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/snappy-java-1.0.3.2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/stax-api-1.0-2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/stax-api-1.0.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/velocity-1.7.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/xmlenc-0.52.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/hadoop-hdfs-0.23.0-sources.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/hadoop-hdfs-0.23.0-test-sources.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/hadoop-hdfs-0.23.0-tests.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/hadoop-hdfs-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/avro-1.5.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/jackson-core-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/jackson-mapper-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/log4j-1.2.15.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/paranamer-2.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/slf4j-api-1.5.11.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/slf4j-log4j12-1.5.11.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/snappy-java-1.0.3.2.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-app-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-core-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-hs-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-jobclient-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-shuffle-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-api-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-applications-distributedshell-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-server-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-server-nodemanager-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-server-resourcemanager-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-server-web-proxy-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-site-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/aopalliance-1.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/avro-1.5.3.jar:/Users/slo/Hadoop/versions/current/bin/../lib/clover-3.0.2.jar:/Users/slo/Hadoop/versions/current/bin/../lib/commons-daemon-1.0.3.jar:/Users/slo/Hadoop/versions/current/bin/../lib/commons-io-2.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/commons-logging-1.1.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/guice-2.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/guice-servlet-2.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/hadoop-annotations-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/jackson-core-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/jackson-mapper-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/jdiff-1.0.9.jar:/Users/slo/Hadoop/versions/current/bin/../lib/junit-4.8.2.jar:/Users/slo/Hadoop/versions/current/bin/../lib/log4j-1.2.15.jar:/Users/slo/Hadoop/versions/current/bin/../lib/netty-3.2.3.Final.jar:/Users/slo/Hadoop/versions/current/bin/../lib/paranamer-2.3.jar:/Users/slo/Hadoop/versions/current/bin/../lib/protobuf-java-2.4.0a.jar:/Users/slo/Hadoop/versions/current/bin/../lib/slf4j-api-1.6.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/slf4j-log4j12-1.6.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/snappy-java-1.0.3.2.jar:/Users/slo/Hadoop/versions/current/conf/rm-config/log4j.properties
STARTUP_MSG:   build = git://devadm900.cc1.ygridcore.net/grid/0/dev/acm/hadoop-trunk/hadoop-common-project/hadoop-common
-r d4fee83ec1462ab9824add6449320617caa7c605; compiled by 'hortonmu' on Thu Nov  3 08:59:12
UTC 2011
************************************************************/
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/slo/Java/Hadoop/versions/hadoop-0.23.0/share/hadoop/common/lib/slf4j-log4j12-1.5.11.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/slo/Java/Hadoop/versions/hadoop-0.23.0/share/hadoop/hdfs/lib/slf4j-log4j12-1.5.11.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/slo/Java/Hadoop/versions/hadoop-0.23.0/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
11/11/18 16:21:59 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType
for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
11/11/18 16:21:59 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType
for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
11/11/18 16:21:59 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType
for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
11/11/18 16:21:59 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType
for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
11/11/18 16:21:59 FATAL resourcemanager.ResourceManager: Error starting ResourceManager
java.lang.IllegalArgumentException: Invalid attribute value for hadoop.security.authentication
of ${SECURITY_TYPE}
	at org.apache.hadoop.security.UserGroupInformation.initUGI(UserGroupInformation.java:215)
	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:194)
	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:185)
	at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:264)
	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:478)
	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:461)
	at org.apache.hadoop.yarn.security.AdminACLsManager.<init>(AdminACLsManager.java:68)
	at org.apache.hadoop.yarn.server.security.ApplicationACLsManager.<init>(ApplicationACLsManager.java:51)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.init(ResourceManager.java:190)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:545)
11/11/18 16:21:59 INFO resourcemanager.ResourceManager: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at homemac/192.168.1.88
************************************************************/
11/11/18 16:21:59 INFO service.CompositeService: Error stopping org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer
java.lang.NullPointerException
	at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer.stop(DelegationTokenRenewer.java:88)
	at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
	at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.stop(ResourceManager.java:470)
	at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:119)
{code}
                
> NPE in Resource Manager shutdown
> --------------------------------
>
>                 Key: MAPREDUCE-3431
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3431
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 0.23.0
>         Environment: OS/X w/ java6
>            Reporter: Steve Loughran
>            Priority: Minor
>
> bringing up a resource manager failed; shutdown triggered an NPE

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message