hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset
Date Tue, 10 Jan 2017 06:36:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814077#comment-15814077
] 

Tsz Wo Nicholas Sze commented on HDFS-11163:
--------------------------------------------

> ... It will require an additional getStoragePolicy RPC per file with the default storage
policy, whereas previously there was no RPC for those files. ...

Indeed, the additional RPC is not needed since HdfsLocatedFileStatus already has the resolved
storage policy.  We don't need to call getStoragePolicy again.

> Mover should move the file blocks to default storage once policy is unset
> -------------------------------------------------------------------------
>
>                 Key: HDFS-11163
>                 URL: https://issues.apache.org/jira/browse/HDFS-11163
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: balancer & mover
>    Affects Versions: 2.8.0
>            Reporter: Surendra Singh Lilhore
>            Assignee: Surendra Singh Lilhore
>         Attachments: HDFS-11163-001.patch, HDFS-11163-002.patch
>
>
> HDFS-9534 added new API in FileSystem to unset the storage policy. Once policy is unset
blocks should move back to the default storage policy.
> Currently mover is not moving file blocks which have zero storage ID
> {code}
>       // currently we ignore files with unspecified storage policy
>       if (policyId == HdfsConstants.BLOCK_STORAGE_POLICY_ID_UNSPECIFIED) {
>         return;
>       }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message