From hdfs-issues-return-227634-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Fri Jul 27 12:19:04 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id C287E180657 for ; Fri, 27 Jul 2018 12:19:03 +0200 (CEST) Received: (qmail 19481 invoked by uid 500); 27 Jul 2018 10:19:02 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 19470 invoked by uid 99); 27 Jul 2018 10:19:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Jul 2018 10:19:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 6A86F1A1AFE for ; Fri, 27 Jul 2018 10:19:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.501 X-Spam-Level: X-Spam-Status: No, score=-109.501 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id fyWfV48WVEDf for ; Fri, 27 Jul 2018 10:19:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 4D9385F3B3 for ; Fri, 27 Jul 2018 10:19:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id D9BA6E25E7 for ; Fri, 27 Jul 2018 10:19:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 5969E2775F for ; Fri, 27 Jul 2018 10:19:00 +0000 (UTC) Date: Fri, 27 Jul 2018 10:19:00 +0000 (UTC) From: "zhouyingchao (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-11573) Support rename between different NameNodes in federated HDFS MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11573: -------------------------------- Flags: Patch > Support rename between different NameNodes in federated HDFS > ------------------------------------------------------------ > > Key: HDFS-11573 > URL: https://issues.apache.org/jira/browse/HDFS-11573 > Project: Hadoop HDFS > Issue Type: Improvement > Components: federation > Reporter: zhouyingchao > Priority: Major > Attachments: HDFS-11573-2.6.5-001.patch, HDFS_federation_rename.pdf > > > Federated file system can improve overall scalability by dividing a single namespace into multiple sub-namespaces. Since the divided sub-namespace are held by different namenodes, rename operation between those sub-namespace is forbidden. Due to this restriction, many applications have to be rewritten to work around the issue after migrated to federated file system. Supporting rename between different namenodes would make it much easier to migrate to federated file systems. > We have finished a preliminary implementation of this feature in a 2.6 branch. I'll upload a write-up regarding the design in a few days. And then I'll re-org the code against the trunk and upload the patch. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org