hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1717) Enable offline deletion of entries in leveldb timeline store
Date Fri, 07 Mar 2014 07:25:45 GMT

    [ https://issues.apache.org/jira/browse/YARN-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923651#comment-13923651

Zhijie Shen commented on YARN-1717:

Hi Billie, thanks for patch. I've just a quick glance at it, which seems generally fine. However,
I've some questions:

1. How can users invoke the deletion operation? Should we provide some shell script command?

2. Is it better to automatically discard the entities whose timestamp is older than the configured
timestamp? At lease, it could be an option other than manually deleting the entities. Thoughts?

3. I'm a bit concerned of returning EntityWithReverseRelatedEntities from the leveldb timeline
store, because it will potentially change the output schema, though the current code doesn't.
However, it may involve additional effort in the future to ensure the output schema will not
be affected, when we make some change in the leveldb timeline store. How about converting
it back to Entity before returning?

> Enable offline deletion of entries in leveldb timeline store
> ------------------------------------------------------------
>                 Key: YARN-1717
>                 URL: https://issues.apache.org/jira/browse/YARN-1717
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Billie Rinaldi
>            Assignee: Billie Rinaldi
>         Attachments: YARN-1717.1.patch, YARN-1717.2.patch, YARN-1717.3.patch, YARN-1717.4.patch,
YARN-1717.5.patch, YARN-1717.6-extra.patch, YARN-1717.6.patch, YARN-1717.7.patch, YARN-1717.8.patch
> The leveldb timeline store implementation needs the following:
> * better documentation of its internal structures
> * internal changes to enable deleting entities
> ** never overwrite existing primary filter entries
> ** add hidden reverse pointers to related entities

This message was sent by Atlassian JIRA

View raw message