hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-6997) Archival Storage: add more tests for data migration and replicaion
Date Thu, 09 Apr 2015 23:02:12 GMT

     [ https://issues.apache.org/jira/browse/HDFS-6997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Andrew Wang updated HDFS-6997:
    Release Note: This JIRA also includes a fix for free space calculation in BlockPlacementPolicyDefault.
Previously, when calculating the amount of free space per storage, it was using the per-node
rather than the per-storage  number of blocks currently scheduled for write. This grossly
overestimates the amount of space to reserve for open files, and can result in storages being
incorrectly marked as full.

I added a release note, up to you if you want to change the summary.

> Archival Storage: add more tests for data migration and replicaion
> ------------------------------------------------------------------
>                 Key: HDFS-6997
>                 URL: https://issues.apache.org/jira/browse/HDFS-6997
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer & mover, namenode
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>            Priority: Minor
>             Fix For: Archival Storage (HDFS-6584)
>         Attachments: h6997_20140905.patch, h6997_20140905b.patch, h6997_20140907.patch
> This JIRA is to add more tests to check if the data migration tool could move the replicas
correctly and if the replication monitor could replicate block correctly when storage policy
is considered.

This message was sent by Atlassian JIRA

View raw message