hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files
Date Wed, 08 Jun 2016 07:08:21 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320159#comment-15320159
] 

Jing Zhao commented on HDFS-10473:
----------------------------------

bq. To simplify, how about Mover tool allows to move EC files only if the target policy is
ARCHIVE/ALL_SDD? We can just log saying, this policy is not recommended for striped EC files,
so ignoring for movements.

Yes, we can do this by now. On the NN side, one possible solution is to ignore certain storage
policies when we choose storage targets for a being-written EC file. This way can minimize
the change and avoid extra O(n) check. Either change needs to update the current documentation
I think.

> Allow only suitable storage policies to be set on striped files
> ---------------------------------------------------------------
>
>                 Key: HDFS-10473
>                 URL: https://issues.apache.org/jira/browse/HDFS-10473
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>         Attachments: HDFS-10473-01.patch
>
>
> Currently some of existing storage policies are not suitable for striped layout files.
> This JIRA proposes to reject setting storage policy on striped files.
> Another thought is to allow only suitable storage polices like ALL_SSD.
> Since the major use case of EC is for cold data, this may not be at high importance.
So, I am ok to reject setting storage policy on striped files at this stage. Please suggest
if others have some thoughts on this.
> Thanks [~zhz] for offline discussion on this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message