hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-9902) Support different values of dfs.datanode.du.reserved per storage type
Date Mon, 09 May 2016 21:13:12 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arpit Agarwal updated HDFS-9902:
--------------------------------
    Release Note: Reserved space can be configured independently for different storage types
for clusters with heterogeneous storage. The 'dfs.datanode.du.reserved' property name can
be suffixed with a storage types (i.e. one of ssd, disk, archival or ram_disk). e.g. reserved
space for RAM_DISK storage can be configured using the property 'dfs.datanode.du.reserved.ram_disk'.
If specific storage type reservation is not configured then the value specified by 'dfs.datanode.du.reserved'
will be used for all volumes.

> Support different values of dfs.datanode.du.reserved per storage type
> ---------------------------------------------------------------------
>
>                 Key: HDFS-9902
>                 URL: https://issues.apache.org/jira/browse/HDFS-9902
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 2.7.2
>            Reporter: Pan Yuxuan
>            Assignee: Brahma Reddy Battula
>             Fix For: 2.8.0
>
>         Attachments: HDFS-9902-02.patch, HDFS-9902-03.patch, HDFS-9902-04.patch, HDFS-9902-05.patch,
HDFS-9902.patch
>
>
> Now Hadoop support different storage type for DISK, SSD, ARCHIVE and RAM_DISK, but they
share one configuration dfs.datanode.du.reserved.
> The DISK size may be several TB and the RAM_DISK size may be only several tens of GB.
> The problem is that when I configure DISK and RAM_DISK (tmpfs) in the same DN, and I
set  dfs.datanode.du.reserved values 10GB, this will waste a lot of RAM_DISK size. 
> Since the usage of RAM_DISK can be 100%, so I don't want dfs.datanode.du.reserved configured
for DISK impacts the usage of tmpfs.
> So can we make a new configuration for RAM_DISK or just skip this configuration for RAM_DISK?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message