ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-18728) During cluster install, Components get timed out icon while starting
Date Fri, 28 Oct 2016 16:01:01 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-18728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15615795#comment-15615795
] 

Hudson commented on AMBARI-18728:
---------------------------------

FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #5886 (See [https://builds.apache.org/job/Ambari-trunk-Commit/5886/])
AMBARI-18728. During cluster install, Components get timed out icon (aonishuk: [http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=a6ef6810053bdf9cc282ec49a76b8277e73f7035])
* (edit) ambari-agent/src/main/python/ambari_agent/StatusCommandsExecutor.py
* (edit) ambari-agent/src/main/python/ambari_agent/ActionQueue.py


> During cluster install, Components get timed out icon while starting
> --------------------------------------------------------------------
>
>                 Key: AMBARI-18728
>                 URL: https://issues.apache.org/jira/browse/AMBARI-18728
>             Project: Ambari
>          Issue Type: Bug
>            Reporter: Andrew Onischuk
>            Assignee: Andrew Onischuk
>             Fix For: 2.5.0
>
>         Attachments: AMBARI-18728.patch
>
>
> This was caused by a very tricky race-condition in the way python multiprocessing.thread
works resulting in deadlock in ambari_agent.ActionQueue thread.
> The problem is the below flow:
> If this all these three get executed at the same time (a very rear occasion):
> 1. Process1 executes queue.get(False)
> 2. Process2 executes queue.put(largeObjectWhichTakesLongTimeToPut)
> 3. Someone kills Process2.
> This results in deadlock in process1 get. Which is caused by queue locks/semaphores to
being released during put of process2.
> I have wrote a script test_race_condition.py to emulate this behaviour and indeed could
reproduce this and test the fix for it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message