hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on
Date Tue, 22 Nov 2016 07:19:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685936#comment-15685936

Wei Zhou commented on HDFS-10885:

Hi, [~rakeshr], sorry for the late response sincerely! I was on travel those days.
Can we add a test case to verify StoragePolicySatisfier is getting stopped due to Mover running.
Thanks for your advises!
Currently in the patch, file lease is also checked besides the existence to make sure the
file was not generated by a Mover exited ungracefully.
      LeaseManager.Lease lease =
      if (lease != null) {
So, the case can not be tested by restarting the NN. What's your opinion? 

Default values are different in hdfs-default.xml and DFSConfigs.java, can we make this same.

The reason of using two different values is that I want to disable SPS for unit tests while
enable it by default when actually been deployed. It's tricky but i really want SPS to be
enabled by default while keeping the patch simple. Any better ways or make them the same?

Also, we need to ensure SPS is started running only in Active NN. I'm OK to do this task via
separate jira if you feel so.
It's great for you to do this task via a separate jira.

> [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on
> ----------------------------------------------------------------------------------
>                 Key: HDFS-10885
>                 URL: https://issues.apache.org/jira/browse/HDFS-10885
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode, namenode
>    Affects Versions: HDFS-10285
>            Reporter: Wei Zhou
>            Assignee: Wei Zhou
>             Fix For: HDFS-10285
>         Attachments: HDFS-10800-HDFS-10885-00.patch, HDFS-10800-HDFS-10885-01.patch,
HDFS-10800-HDFS-10885-02.patch, HDFS-10885-HDFS-10285.03.patch, HDFS-10885-HDFS-10285.04.patch,
HDFS-10885-HDFS-10285.05.patch, HDFS-10885-HDFS-10285.06.patch, HDFS-10885-HDFS-10285.07.patch
> These two can not work at the same time to avoid conflicts and fight with each other.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message