hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Lu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5
Date Wed, 14 Oct 2015 21:30:06 GMT

     [ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Li Lu updated YARN-4219:
------------------------
    Attachment: YARN-4219-trunk.001.patch

Upload a patch to add the leveldb cache storage. To organize this storage, I refactored MemoryTimelineStore,
moved the abstract logic to operate on a general map of entities into a new MapTimelineStore.
Both MemoryTimelineStore and LevelDbCacheTimelineStore are MapTimelineStores, communicating
through the abstract logic through a TimelineStoreMapAdapter. 

> New levelDB cache storage for timeline v1.5
> -------------------------------------------
>
>                 Key: YARN-4219
>                 URL: https://issues.apache.org/jira/browse/YARN-4219
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Li Lu
>            Assignee: Li Lu
>         Attachments: YARN-4219-trunk.001.patch
>
>
> We need to have an "offline" caching storage for timeline server v1.5 after the changes
in YARN-3942. The in memory timeline storage may run into OOM issues when used as a cache
storage for entity file timeline storage. We can refactor the code and have a level db based
caching storage for this use case. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message