hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Xiaoqiao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer
Date Wed, 24 Aug 2016 12:52:21 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

He Xiaoqiao updated HDFS-10782:
-------------------------------
    Status: Patch Available  (was: Open)

re-submit patch.

> Decrease memory frequent exchange of Centralized Cache Management when run balancer
> -----------------------------------------------------------------------------------
>
>                 Key: HDFS-10782
>                 URL: https://issues.apache.org/jira/browse/HDFS-10782
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer & mover, caching
>    Affects Versions: 2.7.1
>            Reporter: He Xiaoqiao
>              Labels: patch
>         Attachments: HDFS-10782-branch-2.001.patch
>
>
> CachedBlocks currently are transparent for Balancer when active feature of centralized
cache management. This makes DataNode exchange memory frequently, because Balancer does not
Distinguish CachedBlock from blocks, so it may trigger mount of cached/uncached ops.
> I think namenode should avoid return CacheBlocks as much as possible when Balanacer#getblocks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message