hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Surendra Singh Lilhore (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11669) [SPS]: Add option in "setStoragePolicy" command to satisfy the policy.
Date Thu, 25 May 2017 05:07:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16024201#comment-16024201

Surendra Singh Lilhore commented on HDFS-11669:

bq. how about postponing this task to next phase once we finished merging the existing code
to trunk code?
Sure, I am ok with this...

bq. One idea to reduce the locking time during recursive iteration is, acquire & release
lock for each sub-dirs rather than holding lock at the root till all the sub-dirs are visited.
Can we do something same as storage policy. Set the xattr in one directory and schedule it
for SPS. Later SPS thread will find recursively all the sub directory/file and satisfy the
policy.  So we can avoid setting recursively xattr.

> [SPS]: Add option in "setStoragePolicy" command to satisfy the policy.
> ----------------------------------------------------------------------
>                 Key: HDFS-11669
>                 URL: https://issues.apache.org/jira/browse/HDFS-11669
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode, shell
>    Affects Versions: HDFS-10285
>            Reporter: Surendra Singh Lilhore
>            Assignee: Surendra Singh Lilhore
>         Attachments: HDFS-11669-HDFS-10285.001.patch
> Add one new option {{-satisfypolicy}} in {{setStoragePolicy}} command to satisfy the
storage policy.
> {noformat}
> hdfs storagepolicies -setStoragePolicy -path <path> -policy <policy> -satisfypolicy
> {noformat}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message