Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9E1AB200C81 for ; Fri, 26 May 2017 17:37:11 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 9CC68160BAF; Fri, 26 May 2017 15:37:11 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E37B9160BB8 for ; Fri, 26 May 2017 17:37:10 +0200 (CEST) Received: (qmail 58502 invoked by uid 500); 26 May 2017 15:37:10 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 58491 invoked by uid 99); 26 May 2017 15:37:10 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 May 2017 15:37:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id AA77B180BA9 for ; Fri, 26 May 2017 15:37:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id W_Uhp3AObFba for ; Fri, 26 May 2017 15:37:08 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 1AF2460D67 for ; Fri, 26 May 2017 15:37:08 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id C7347E0DB3 for ; Fri, 26 May 2017 15:37:06 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 3925421B5E for ; Fri, 26 May 2017 15:37:05 +0000 (UTC) Date: Fri, 26 May 2017 15:37:05 +0000 (UTC) From: "Kihwal Lee (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 26 May 2017 15:37:11 -0000 [ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11856: ------------------------------ Attachment: HDFS-11856-02.branch-2.patch Reattaching the branch-2 patch with a different name to kick the pre-commit. > Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates > ---------------------------------------------------------------------------------- > > Key: HDFS-11856 > URL: https://issues.apache.org/jira/browse/HDFS-11856 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs-client, rolling upgrades > Affects Versions: 2.7.3 > Reporter: Vinayakumar B > Assignee: Vinayakumar B > Attachments: HDFS-11856-01.patch, HDFS-11856-02.branch-2.patch, HDFS-11856-02.patch, HDFS-11856-branch-2-02.patch, HDFS-11856-branch-2.7-02.patch, HDFS-11856-branch-2.8-02.patch > > > During rolling upgrade if the DN gets restarted, then it will send special OOB_RESTART status to all streams opened for write. > 1. Local clients will wait for 30 seconds to datanode to come back. > 2. Remote clients will consider these nodes as bad nodes and continue with pipeline recoveries and write. These restarted nodes will be considered as bad, and will be excluded for lifetime of stream. > In case of small cluster, where total nodes itself is 3, each time a remote node restarts for upgrade, it will be excluded. > So a stream writing to 3 nodes initial, will end-up writing to only one node at the end, there are no other nodes to replace. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org