hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files
Date Wed, 08 Jun 2016 06:47:21 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320126#comment-15320126

Uma Maheswara Rao G commented on HDFS-10473:

>Also, do you see any critical issue if an admin really sets WARM/ONE_SSD policy to EC
In striping model all data blocks are equally important. So, there is no meaning to set ONE_SSD
policy for this files. This is the only point I had. I am not sure this is fine.  
To simplify, how about Mover tool allows to move EC files only if the target policy is ARCHIVE/ALL_SDD
? (because allowing Mover tool to do other policy(ONE_SSD, .etc) movements are not making
any sense to me). We can just log saying, this policy is not recommended for striped EC files,
so ignoring for movements.
Let's leave NN side changes as is since that is bringing complexities to handle.

> Allow only suitable storage policies to be set on striped files
> ---------------------------------------------------------------
>                 Key: HDFS-10473
>                 URL: https://issues.apache.org/jira/browse/HDFS-10473
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>         Attachments: HDFS-10473-01.patch
> Currently some of existing storage policies are not suitable for striped layout files.
> This JIRA proposes to reject setting storage policy on striped files.
> Another thought is to allow only suitable storage polices like ALL_SSD.
> Since the major use case of EC is for cold data, this may not be at high importance.
So, I am ok to reject setting storage policy on striped files at this stage. Please suggest
if others have some thoughts on this.
> Thanks [~zhz] for offline discussion on this.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message