Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Sun, 16 Oct 2016 03:26:22 +0000 (UTC)
From: "Ming Ma (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.12910913.1446775158000.841764.1476588382198@Atlassian.JIRA>
In-Reply-To: <JIRA.12910913.1446775158000@Atlassian.JIRA>
References: <JIRA.12910913.1446775158000@Atlassian.JIRA> <JIRA.12910913.1446775158466@arcas>
Subject: [jira] [Updated] (HDFS-9390) Block management for maintenance
 states
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Sun, 16 Oct 2016 03:26:24 -0000


     [ https://issues.apache.org/jira/browse/HDFS-9390?page=3Dcom.atlassian=
.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ming Ma updated HDFS-9390:
--------------------------
    Attachment:     (was: HDFS-9390-5.patch)

> Block management for maintenance states
> ---------------------------------------
>
>                 Key: HDFS-9390
>                 URL: https://issues.apache.org/jira/browse/HDFS-9390
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Ming Ma
>            Assignee: Ming Ma
>         Attachments: HDFS-9390-2.patch, HDFS-9390-3.patch, HDFS-9390-4.pa=
tch, HDFS-9390.patch
>
>
> When a node is transitioned to/stay in/transitioned out of maintenance st=
ate, we need to make sure blocks w.r.t. that nodes are properly handled.
> * When nodes are put into maintenance, it will first go to ENTERING_MAINT=
ENANCE, and make sure blocks are minimally replicated before the nodes are =
transitioned to IN_MAINTENANCE.
> * Do not replica blocks when nodes are in maintenance states. Maintenance=
 replica will remain in BlockMaps and thus is still considered valid from b=
lock replication point of view. In other words, putting a node to =E2=80=9C=
maintenance=E2=80=9D mode won=E2=80=99t trigger BlockManager to replicate i=
ts blocks.
> * Do not invalidate replicas on node under maintenance. After any file's =
replication factor is reduced, NN needs to invalidate some replicas. It sho=
uld exclude nodes under maintenance in the handling.
> * Do not put IN_MAINTENANCE replicas in LocatedBlock for read operation.
> * Do not allocate any new block on nodes under maintenance.
> * Have Balancer exclude nodes under maintenance.
> * Exclude nodes under maintenance for DN cache.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org