Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-issues@hadoop.apache.org
Date: Thu, 28 Apr 2016 14:31:12 +0000 (UTC)
From: "Jason Lowe (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12963502.1461853842000.59660.1461853872836@Atlassian.JIRA>
In-Reply-To: <JIRA.12963502.1461853842000@Atlassian.JIRA>
References: <JIRA.12963502.1461853842000@Atlassian.JIRA>
 <JIRA.12963502.1461853842688@arcas>
Subject: [jira] [Created] (YARN-5008) LeveldbRMStateStore database can grow
 substantially leading to long recovery times
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Jason Lowe created YARN-5008:
--------------------------------

             Summary: LeveldbRMStateStore database can grow substantially leading to long recovery times
                 Key: YARN-5008
                 URL: https://issues.apache.org/jira/browse/YARN-5008
             Project: Hadoop YARN
          Issue Type: Bug
          Components: resourcemanager
    Affects Versions: 2.7.0
            Reporter: Jason Lowe
            Assignee: Jason Lowe


On large clusters with high application churn the background compaction in leveldb may not be able to keep up with the write rate.  This can lead to large leveldb databases that take many minutes to recover despite not having very much real data in the database to load.  Most the time is spent traversing tables full of keys that have been deleted.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)