hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoyu Yao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report
Date Fri, 10 Mar 2017 17:48:04 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xiaoyu Yao updated HDFS-11469:
------------------------------
    Attachment: HDFS-11469-HDFS-7240.001.patch

Attach a patch that support container allocation 
1. with replication factor and multi-datanode pipeline
2. pluggable container placement policy and two policies added (random healthy nodes and remaining
capacity)
3. unit test for container placement policy.
4. support specifying capacity of datanode for MiniOzoneCluster.
4. Fix unit test issue (disable some volume related stress tests)
5. Fix the StorageContainerManager clean issue upon stop().


> Ozone: SCM: Container allocation based on node report
> -----------------------------------------------------
>
>                 Key: HDFS-11469
>                 URL: https://issues.apache.org/jira/browse/HDFS-11469
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Xiaoyu Yao
>            Assignee: Xiaoyu Yao
>         Attachments: HDFS-11469-HDFS-7240.001.patch
>
>
> The initial patch will make the datanode chosen policy for container creation pluggable.
It will add at least two built-in policies: 
> 1. random (existing)
> 2. utilization of the storage on different data nodes. 
> Additional policy based on  
> 3. storage type, etc. will be added separately. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message