hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities
Date Fri, 03 Apr 2015 23:17:53 GMT
Jonathan Eagles created YARN-3448:

             Summary: Add Rolling Time To Lives Level DB Plugin Capabilities
                 Key: YARN-3448
                 URL: https://issues.apache.org/jira/browse/YARN-3448
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Jonathan Eagles

For large applications, the majority of the time in LeveldbTimelineStore is spent deleting
old entities record at a time. A write lock is held during the entire deletion phase which
in practice can be hours. An alternative is to create a rolling set of databases that age
out and can be efficiently removed via a recursive directory delete. The removes the lock
in the deletion thread and clients and servers can share access to the underlying database
which already implements its only internal locking mechanism.

This message was sent by Atlassian JIRA

View raw message