hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities
Date Fri, 03 Apr 2015 23:17:53 GMT
Jonathan Eagles created YARN-3448:
-------------------------------------

             Summary: Add Rolling Time To Lives Level DB Plugin Capabilities
                 Key: YARN-3448
                 URL: https://issues.apache.org/jira/browse/YARN-3448
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Jonathan Eagles


For large applications, the majority of the time in LeveldbTimelineStore is spent deleting
old entities record at a time. A write lock is held during the entire deletion phase which
in practice can be hours. An alternative is to create a rolling set of databases that age
out and can be efficiently removed via a recursive directory delete. The removes the lock
in the deletion thread and clients and servers can share access to the underlying database
which already implements its only internal locking mechanism.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message