hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background
Date Mon, 07 Aug 2017 08:44:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16116274#comment-16116274
] 

Weiwei Yang commented on HDFS-12196:
------------------------------------

Hi [~vagarychen]

Thanks for raising up your concern. The reason I did not use LRUMap or Guava cache here because
they both evict something when cache gets full. But in this case, I don't want to remove any
thing from cache (become an incomplete result set) so I claim it as a fixed size list, once
reaches its cap then pause further task executions.

This might be a bit over designed at present, given the truth we are not going to use the
cache any time soon, I removed that part in v3 patch. Lets get the basic stuff working first.
If moving on we need to implement anything similar, we can revisit this.

Thanks for sharing your thought, it is quite helpful. I have uploaded v3 patch. Please help
to review. Thanks. 

> Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background
> ----------------------------------------------------------------------------------------------
>
>                 Key: HDFS-12196
>                 URL: https://issues.apache.org/jira/browse/HDFS-12196
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>         Attachments: HDFS-12196-HDFS-7240.001.patch, HDFS-12196-HDFS-7240.002.patch
>
>
> Implement a recycling service running on datanode to delete stale blocks.  The recycling
service scans staled blocks for each container and delete chunks and references periodically.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message