hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2183) Cleaner service for cache manager
Date Thu, 23 Oct 2014 18:11:35 GMT

    [ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181684#comment-14181684

Karthik Kambatla commented on YARN-2183:

bq. Without this check, we would have two cleaner runs back to back which is somewhat wasteful.
I don't entirely remember my train of thought, but I can take a look again and see if we can
implement it in a simpler way and get the same guarantee. May be, after the next patch. 

bq. Currently CleanerTask.cleanResourceReferences() is generic: i.e. it does not depend on
the type of the store.
Can we keep this method as is, but mark it protected. The store implementations can choose
to use it.

> Cleaner service for cache manager
> ---------------------------------
>                 Key: YARN-2183
>                 URL: https://issues.apache.org/jira/browse/YARN-2183
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Chris Trezzo
>            Assignee: Chris Trezzo
>         Attachments: YARN-2183-trunk-v1.patch, YARN-2183-trunk-v2.patch, YARN-2183-trunk-v3.patch,
YARN-2183-trunk-v4.patch, YARN-2183-trunk-v5.patch
> Implement the cleaner service for the cache manager along with metrics for the service.
This service is responsible for cleaning up old resource references in the manager and removing
stale entries from the cache.

This message was sent by Atlassian JIRA

View raw message