From hdfs-issues-return-207496-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Wed Jan 10 12:59:04 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 97D4218072F for ; Wed, 10 Jan 2018 12:59:04 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 882E1160C2E; Wed, 10 Jan 2018 11:59:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id CCFF1160C23 for ; Wed, 10 Jan 2018 12:59:03 +0100 (CET) Received: (qmail 73091 invoked by uid 500); 10 Jan 2018 11:59:02 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 73080 invoked by uid 99); 10 Jan 2018 11:59:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Jan 2018 11:59:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 42F4AC0E14 for ; Wed, 10 Jan 2018 11:59:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.911 X-Spam-Level: X-Spam-Status: No, score=-99.911 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id M8C7gSRw1F5l for ; Wed, 10 Jan 2018 11:59:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 733345F2C4 for ; Wed, 10 Jan 2018 11:59:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id E334BE25BD for ; Wed, 10 Jan 2018 11:59:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 3603A274D2 for ; Wed, 10 Jan 2018 11:59:00 +0000 (UTC) Date: Wed, 10 Jan 2018 11:59:00 +0000 (UTC) From: "Yiqun Lin (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (HDFS-12934) RBF: Federation supports global quota MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319861#comment-16319861 ] Yiqun Lin edited comment on HDFS-12934 at 1/10/18 11:58 AM: ------------------------------------------------------------ Attach new patch to fix compile error on Java 7 for branch-2. was (Author: linyiqun): Attach new patch to fix compile error in branch-2. > RBF: Federation supports global quota > ------------------------------------- > > Key: HDFS-12934 > URL: https://issues.apache.org/jira/browse/HDFS-12934 > Project: Hadoop HDFS > Issue Type: Sub-task > Affects Versions: 3.0.0 > Reporter: Yiqun Lin > Assignee: Yiqun Lin > Labels: RBF > Fix For: 3.1.0, 2.10.0 > > Attachments: HDFS-12934-branch-2.001.patch, HDFS-12934-branch-2.002.patch, HDFS-12934.001.patch, HDFS-12934.002.patch, HDFS-12934.003.patch, HDFS-12934.004.patch, HDFS-12934.005.patch, HDFS-12934.006.patch, HDFS-12934.007.patch, HDFS-12934.008.patch, RBF support global quota.pdf > > > Now federation doesn't support set the global quota for each folder. Currently the quota will be applied for each subcluster under the specified folder via RPC call. > It will be very useful for users that federation can support setting global quota and exposing the command of this. > In a federated environment, a folder can be spread across multiple subclusters. For this reason, we plan to solve this by following way: > # Set global quota across each subcluster. We don't allow each subcluster can exceed maximun quota value. > # We need to construct one cache map for storing the sum quota usage of these subclusters under federation folder. Every time we want to do WRITE operation under specified folder, we will get its quota usage from cache and verify its quota. If quota exceeded, throw exception, otherwise update its quota usage in cache when finishing operations. > The quota will be set to mount table and as a new field in mount table. The set/unset command will be like: > {noformat} > hdfs dfsrouteradmin -setQuota -ns -ss > hdfs dfsrouteradmin -clrQuota > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org