Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 63F119C79 for ; Thu, 11 Oct 2012 17:45:46 +0000 (UTC) Received: (qmail 92473 invoked by uid 500); 11 Oct 2012 17:45:45 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 92434 invoked by uid 500); 11 Oct 2012 17:45:45 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 92396 invoked by uid 99); 11 Oct 2012 17:45:45 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Oct 2012 17:45:45 +0000 Date: Thu, 11 Oct 2012 17:45:45 +0000 (UTC) From: "Arun C Murthy (JIRA)" To: common-issues@hadoop.apache.org Message-ID: <570273426.28046.1349977545370.JavaMail.jiratomcat@arcas> Subject: [jira] [Closed] (HADOOP-8770) NN should not RPC to self to find trash defaults (causes deadlock) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy closed HADOOP-8770. --------------------------------- > NN should not RPC to self to find trash defaults (causes deadlock) > ------------------------------------------------------------------ > > Key: HADOOP-8770 > URL: https://issues.apache.org/jira/browse/HADOOP-8770 > Project: Hadoop Common > Issue Type: Bug > Components: trash > Affects Versions: 2.0.2-alpha > Reporter: Todd Lipcon > Assignee: Eli Collins > Priority: Blocker > Fix For: 2.0.2-alpha > > Attachments: hdfs-3876.txt, hdfs-3876.txt, hdfs-3876.txt, hdfs-3876.txt > > > When transitioning a SBN to active, I ran into the following situation: > - the TrashPolicy first gets loaded by an IPC Server Handler thread. The {{initialize}} function then tries to make an RPC to the same node to find out the defaults. > - This is happening inside the NN write lock (since it's part of the active initialization). Hence, all of the other handler threads are already blocked waiting to get the NN lock. > - Since no handler threads are free, the RPC blocks forever and the NN never enters active state. > We need to have a general policy that the NN should never make RPCs to itself for any reason, due to potential for deadlocks like this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira