hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on
Date Tue, 22 Nov 2016 07:19:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685936#comment-15685936
] 

Wei Zhou commented on HDFS-10885:
---------------------------------

Hi, [~rakeshr], sorry for the late response sincerely! I was on travel those days.
{quote}
Can we add a test case to verify StoragePolicySatisfier is getting stopped due to Mover running.
Thanks for your advises!
{quote}
Currently in the patch, file lease is also checked besides the existence to make sure the
file was not generated by a Mover exited ungracefully.
{code:borderStyle=solid}
      LeaseManager.Lease lease =
          ((FSNamesystem)namesystem).getLeaseManager().getLease(ifile);
      if (lease != null) {
{code}
So, the case can not be tested by restarting the NN. What's your opinion? 

{quote}
Default values are different in hdfs-default.xml and DFSConfigs.java, can we make this same.

{quote}
The reason of using two different values is that I want to disable SPS for unit tests while
enable it by default when actually been deployed. It's tricky but i really want SPS to be
enabled by default while keeping the patch simple. Any better ways or make them the same?

{quote}
Also, we need to ensure SPS is started running only in Active NN. I'm OK to do this task via
separate jira if you feel so.
{quote}
It's great for you to do this task via a separate jira.
Thanks!

> [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on
> ----------------------------------------------------------------------------------
>
>                 Key: HDFS-10885
>                 URL: https://issues.apache.org/jira/browse/HDFS-10885
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode, namenode
>    Affects Versions: HDFS-10285
>            Reporter: Wei Zhou
>            Assignee: Wei Zhou
>             Fix For: HDFS-10285
>
>         Attachments: HDFS-10800-HDFS-10885-00.patch, HDFS-10800-HDFS-10885-01.patch,
HDFS-10800-HDFS-10885-02.patch, HDFS-10885-HDFS-10285.03.patch, HDFS-10885-HDFS-10285.04.patch,
HDFS-10885-HDFS-10285.05.patch, HDFS-10885-HDFS-10285.06.patch, HDFS-10885-HDFS-10285.07.patch
>
>
> These two can not work at the same time to avoid conflicts and fight with each other.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message