hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3345) Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes
Date Mon, 07 Nov 2011 09:53:52 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145309#comment-13145309
] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-3345:
----------------------------------------------------

Copying pasting the test-logs just in case Jenkins deletes them.
{code}
{2011-11-03 07:09:07,511 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476))
- appattempt_1320304139196_0003_000001 State change from NEW to SUBMITTED
2011-11-03 07:09:07,512 INFO  [Node Status Updater] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatus(210))
- Sending out status for container: container_id {, app_attempt_id {, application_id {, id:
2, cluster_timestamp: 1320304139196, }, attemptId: 1, }, id: 1, }, state: C_RUNNING, diagnostics:
"Container killed by the ApplicationMaster.\n", exit_status: -1000, 
2011-11-03 07:09:07,511 INFO  [main] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140))
- USER=jenkins	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS
APPID=application_1320304139196_0003
2011-11-03 07:09:07,512 INFO  [AsyncDispatcher event handler] rmnode.RMNodeImpl (RMNodeImpl.java:handle(293))
- Processing asf005.sp2.ygridcore.net:44653 of type STATUS_UPDATE
2011-11-03 07:09:07,512 INFO  [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:addApplication(288))
- Application Submission: application_1320304139196_0003 from jenkins, currently active: 1
2011-11-03 07:09:07,513 INFO  [main] server.TestContainerManagerSecurity (TestContainerManagerSecurity.java:submitAndRegisterApplication(373))
- Waiting for applicationAttempt to be created.. 
2011-11-03 07:09:07,513 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464))
- Processing event for appattempt_1320304139196_0003_000001 of type APP_ACCEPTED
2011-11-03 07:09:07,513 INFO  [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:nodeUpdate(571))
- Node heartbeat asf005.sp2.ygridcore.net:44653 available resource = memory: 4096
2011-11-03 07:09:07,515 INFO  [ResourceManager Event Processor] rmcontainer.RMContainerImpl
(RMContainerImpl.java:handle(195)) - Processing container_1320304139196_0003_01_000001 of
type START
2011-11-03 07:09:07,515 INFO  [ResourceManager Event Processor] rmcontainer.RMContainerImpl
(RMContainerImpl.java:handle(207)) - container_1320304139196_0003_01_000001 Container Transitioned
from NEW to ALLOCATED
2011-11-03 07:09:07,516 INFO  [ResourceManager Event Processor] resourcemanager.RMAuditLogger
(RMAuditLogger.java:logSuccess(98)) - USER=jenkins	OPERATION=AM Allocated Container	TARGET=SchedulerApp
RESULT=SUCCESS	APPID=application_1320304139196_0003	CONTAINERID=container_1320304139196_0003_01_000001
2011-11-03 07:09:07,516 INFO  [ResourceManager Event Processor] scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(103))
- Assigned container container_1320304139196_0003_01_000001 of capacity memory: 1024 on host
asf005.sp2.ygridcore.net:44653, which currently has 1 containers, memory: 1024 used and memory:
3072 available
2011-11-03 07:09:07,516 INFO  [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:nodeUpdate(576))
- Node after allocation asf005.sp2.ygridcore.net:44653 resource = memory: 3072
2011-11-03 07:09:07,516 INFO  [AsyncDispatcher event handler] rmcontainer.RMContainerImpl
(RMContainerImpl.java:handle(195)) - Processing container_1320304139196_0003_01_000001 of
type ACQUIRED
2011-11-03 07:09:07,517 INFO  [AsyncDispatcher event handler] rmcontainer.RMContainerImpl
(RMContainerImpl.java:handle(207)) - container_1320304139196_0003_01_000001 Container Transitioned
from ALLOCATED to ACQUIRED
2011-11-03 07:09:07,517 WARN  [ContainersLauncher #0] nodemanager.DefaultContainerExecutor
(DefaultContainerExecutor.java:launchContainer(184)) - Exit code from task is : 143
2011-11-03 07:09:07,517 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476))
- appattempt_1320304139196_0003_000001 State change from SUBMITTED to SCHEDULED
2011-11-03 07:09:07,517 INFO  [ContainersLauncher #0] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(154))
- 
2011-11-03 07:09:07,517 INFO  [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(416))
- Processing event for application_1320304139196_0003 of type APP_ACCEPTED
2011-11-03 07:09:07,518 INFO  [ContainersLauncher #0] container.Container (ContainerImpl.java:handle(818))
- Processing container_1320304139196_0002_01_000001 of type UPDATE_DIAGNOSTICS_MSG
2011-11-03 07:09:07,518 INFO  [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(428))
- application_1320304139196_0003 State change from SUBMITTED to ACCEPTED
2011-11-03 07:09:07,518 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464))
- Processing event for appattempt_1320304139196_0003_000001 of type CONTAINER_ALLOCATED
2011-11-03 07:09:07,519 ERROR [AsyncDispatcher event handler] resourcemanager.ResourceManager
(ResourceManager.java:handle(380)) - Error in handling event type CONTAINER_ALLOCATED for
applicationAttempt application_1320304139196_0003
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
	at java.util.ArrayList.RangeCheck(ArrayList.java:547)
	at java.util.ArrayList.get(ArrayList.java:322)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:614)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:603)
	at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:357)
	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:298)
	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:469)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:80)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:378)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:359)
	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
	at java.lang.Thread.run(Thread.java:662)
2011-11-03 07:09:07,519 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464))
- Processing event for appattempt_1320304139196_0003_000001 of type CONTAINER_ACQUIRED
2011-11-03 07:09:07,520 ERROR [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(471))
- Can't handle this event at current state
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: CONTAINER_ACQUIRED
at SCHEDULED
	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:301)
	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:469)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:80)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:378)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:359)
	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
	at java.lang.Thread.run(Thread.java:662)
2011-11-03 07:09:07,526 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818))
- Processing container_1320304139196_0002_01_000001 of type KILL_CONTAINER
2011-11-03 07:09:07,526 WARN  [AsyncDispatcher event handler] containermanager.ContainerManagerImpl
(ContainerManagerImpl.java:handle(495)) - Event EventType: KILL_CONTAINER sent to absent container
container_1320304139196_0002_01_000002
2011-11-03 07:09:07,526 INFO  [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(376))
- Processing application_1320304139196_0002 of type FINISH_APPLICATION
2011-11-03 07:09:07,526 INFO  [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(387))
- Application application_1320304139196_0002 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT
2011-11-03 07:09:07,527 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818))
- Processing container_1320304139196_0002_01_000001 of type CONTAINER_KILLED_ON_REQUEST
2011-11-03 07:09:07,527 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(830))
- Container container_1320304139196_0002_01_000001 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2011-11-03 07:09:07,527 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818))
- Processing container_1320304139196_0002_01_000001 of type KILL_CONTAINER
2011-11-03 07:09:07,527 INFO  [AsyncDispatcher event handler] localizer.LocalizedResource
(LocalizedResource.java:handle(184)) - Processing file:/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/org.apache.hadoop.yarn.server.TestContainerManagerSecurity-localDir/testFile-application_1320304139196_0002
of type RELEASE
2011-11-03 07:09:07,528 INFO  [DeletionService #3] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(265))
- Deleting absolute path : /home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/org.apache.hadoop.yarn.server.TestContainerManagerSecurity/org.apache.hadoop.yarn.server.TestContainerManagerSecurity-localDir-nm-0/usercache/jenkins/appcache/application_1320304139196_0002/container_1320304139196_0002_01_000001
2011-11-03 07:09:07,528 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818))
- Processing container_1320304139196_0002_01_000001 of type CONTAINER_RESOURCES_CLEANEDUP
2011-11-03 07:09:07,528 INFO  [AsyncDispatcher event handler] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89))
- USER=jenkins	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1320304139196_0002
CONTAINERID=container_1320304139196_0002_01_000001
2011-11-03 07:09:07,528 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(830))
- Container container_1320304139196_0002_01_000001 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL
to DONE
2011-11-03 07:09:07,529 INFO  [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(376))
- Processing application_1320304139196_0002 of type APPLICATION_CONTAINER_FINISHED
{code}
                
> Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes
> ----------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3345
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3345
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, resourcemanager
>    Affects Versions: 0.23.0
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>
> See https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1247//testReport/org.apache.hadoop.yarn.server/TestContainerManagerSecurity/testUnauthorizedUser/

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message