hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Surendra Singh Lilhore (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir
Date Tue, 29 Aug 2017 11:42:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145158#comment-16145158
] 

Surendra Singh Lilhore commented on HDFS-12291:
-----------------------------------------------

Attached v2 patch. Please review.

Thanks [~umamaheswararao] and [~rakeshr] for offline discussion. Reusing the EDEKs(HDFS-10899)
code to traverse  directory recursively. 

[~xiaochen], can you look in to v2 patch and give your opinion. I changed some code in {{ReencryptionHandler}}.

> [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the
files under the given dir
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-12291
>                 URL: https://issues.apache.org/jira/browse/HDFS-12291
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode, namenode
>            Reporter: Rakesh R
>            Assignee: Surendra Singh Lilhore
>         Attachments: HDFS-12291-HDFS-10285-01.patch, HDFS-12291-HDFS-10285-02.patch
>
>
> For the given source path directory, presently SPS consider only the files immediately
under the directory(only one level of scanning) for satisfying the policy. It WON’T do recursive
directory scanning and then schedules SPS tasks to satisfy the storage policy of all the files
till the leaf node. 
> The idea of this jira is to discuss & implement an efficient recursive directory
iteration mechanism and satisfies storage policy for all the files under the given directory.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message