hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files
Date Tue, 14 Jun 2016 21:22:30 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15330637#comment-15330637

Uma Maheswara Rao G commented on HDFS-10473:

We also need to consider other scenarios such as the NameNode tries to choose extra datanodes
to reconstruct EC blocks with missing internal blocks (i.e., {{ErasureCodingWork#chooseTargets}}).
Maybe we can consider adding the extra check introduced in the current patch directly in {{INodeFile#getStoragePolicyID}}?
Good point [~jingzhao]. Let me think to update patch for covering this scenario.
Thanks a lot Zhe for reviews.
[~arpitagarwal] Thanks. Sure.

> Allow only suitable storage policies to be set on striped files
> ---------------------------------------------------------------
>                 Key: HDFS-10473
>                 URL: https://issues.apache.org/jira/browse/HDFS-10473
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>         Attachments: HDFS-10473-01.patch, HDFS-10473-02.patch, HDFS-10473-03.patch
> Currently some of existing storage policies are not suitable for striped layout files.
> This JIRA proposes to reject setting storage policy on striped files.
> Another thought is to allow only suitable storage polices like ALL_SSD.
> Since the major use case of EC is for cold data, this may not be at high importance.
So, I am ok to reject setting storage policy on striped files at this stage. Please suggest
if others have some thoughts on this.
> Thanks [~zhz] for offline discussion on this.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message