Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-dev@hadoop.apache.org
Date: Wed, 16 Oct 2013 01:47:41 +0000 (UTC)
From: "Colin Patrick McCabe (JIRA)" <jira@apache.org>
To: hdfs-dev@hadoop.apache.org
Message-ID: <JIRA.12674041.1381887970997.69990.1381888061774@arcas>
In-Reply-To: <JIRA.12674041.1381887970997@arcas>
References: <JIRA.12674041.1381887970997@arcas>
Subject: [jira] [Created] (HDFS-5366) recaching improvements
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Colin Patrick McCabe created HDFS-5366:
------------------------------------------

             Summary: recaching improvements
                 Key: HDFS-5366
                 URL: https://issues.apache.org/jira/browse/HDFS-5366
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: namenode
    Affects Versions: HDFS-4949
            Reporter: Colin Patrick McCabe
            Assignee: Colin Patrick McCabe


There are a few things about our HDFS-4949 recaching strategy that could be improved.

* We should monitor the DN's maximum and current mlock'ed memory consumption levels, so that we don't ask the DN to do stuff it can't.

* We should not try to initiate caching on stale DataNodes (although we should not recache things stored on such nodes until they're declared dead).

* We might want to resend the {{DNA_CACHE}} or {{DNA_UNCACHE}} command a few times before giving up.  Currently, we only send it once.


--
This message was sent by Atlassian JIRA
(v6.1#6144)