hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang Xie (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-5461) fallback to non-ssr(local short circuit reads) while oom detected
Date Tue, 05 Nov 2013 06:58:18 GMT
Liang Xie created HDFS-5461:
-------------------------------

             Summary: fallback to non-ssr(local short circuit reads) while oom detected
                 Key: HDFS-5461
                 URL: https://issues.apache.org/jira/browse/HDFS-5461
             Project: Hadoop HDFS
          Issue Type: Improvement
    Affects Versions: 2.2.0, 3.0.0
            Reporter: Liang Xie


Currently, the DirectBufferPool used by ssr feature seems doesn't have a upper-bound limit
except DirectMemory VM option. So there's a risk to encounter direct memory oom. see HBASE-8143
for example.
IMHO, maybe we could improve it a bit:
1) detect OOM or reach a setting up-limit from caller, then fallback to non-ssr
2) add a new metric about current raw consumed direct memory size.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message