hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brahma Reddy Battula (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9902) Support different values of dfs.datanode.du.reserved per storage type
Date Thu, 11 May 2017 05:02:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005887#comment-16005887

Brahma Reddy Battula commented on HDFS-9902:

Committed backport from HDFS-11785 to branch-2.7. Changed fixVersion.

> Support different values of dfs.datanode.du.reserved per storage type
> ---------------------------------------------------------------------
>                 Key: HDFS-9902
>                 URL: https://issues.apache.org/jira/browse/HDFS-9902
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 2.7.2
>            Reporter: Pan Yuxuan
>            Assignee: Brahma Reddy Battula
>              Labels: release-blocker
>             Fix For: 2.8.0, 2.7.4, 3.0.0-alpha1
>         Attachments: HDFS-9902-02.patch, HDFS-9902-03.patch, HDFS-9902-04.patch, HDFS-9902-05.patch,
HDFS-9902-branch-2.7.patch, HDFS-9902.patch
> Now Hadoop support different storage type for DISK, SSD, ARCHIVE and RAM_DISK, but they
share one configuration dfs.datanode.du.reserved.
> The DISK size may be several TB and the RAM_DISK size may be only several tens of GB.
> The problem is that when I configure DISK and RAM_DISK (tmpfs) in the same DN, and I
set  dfs.datanode.du.reserved values 10GB, this will waste a lot of RAM_DISK size. 
> Since the usage of RAM_DISK can be 100%, so I don't want dfs.datanode.du.reserved configured
for DISK impacts the usage of tmpfs.
> So can we make a new configuration for RAM_DISK or just skip this configuration for RAM_DISK?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message