hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-5366) recaching improvements
Date Wed, 16 Oct 2013 01:47:41 GMT
Colin Patrick McCabe created HDFS-5366:

             Summary: recaching improvements
                 Key: HDFS-5366
                 URL: https://issues.apache.org/jira/browse/HDFS-5366
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: namenode
    Affects Versions: HDFS-4949
            Reporter: Colin Patrick McCabe
            Assignee: Colin Patrick McCabe

There are a few things about our HDFS-4949 recaching strategy that could be improved.

* We should monitor the DN's maximum and current mlock'ed memory consumption levels, so that
we don't ask the DN to do stuff it can't.

* We should not try to initiate caching on stale DataNodes (although we should not recache
things stored on such nodes until they're declared dead).

* We might want to resend the {{DNA_CACHE}} or {{DNA_UNCACHE}} command a few times before
giving up.  Currently, we only send it once.

This message was sent by Atlassian JIRA

View raw message