Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6667A200BAF for ; Mon, 31 Oct 2016 22:23:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 650A7160B09; Mon, 31 Oct 2016 21:23:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id AE1C1160AED for ; Mon, 31 Oct 2016 22:22:59 +0100 (CET) Received: (qmail 57503 invoked by uid 500); 31 Oct 2016 21:22:58 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 57441 invoked by uid 99); 31 Oct 2016 21:22:58 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Oct 2016 21:22:58 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id AD9382C2A66 for ; Mon, 31 Oct 2016 21:22:58 +0000 (UTC) Date: Mon, 31 Oct 2016 21:22:58 +0000 (UTC) From: "Xiaobing Zhou (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 31 Oct 2016 21:23:00 -0000 [ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623459#comment-15623459 ] Xiaobing Zhou commented on HDFS-11065: -------------------------------------- I re-worded the desc, thanks [~liuml07] for reminding me. I also posted the initial patch v000, please help to review thx. > Add space quota tests for heterogenous storages > ----------------------------------------------- > > Key: HDFS-11065 > URL: https://issues.apache.org/jira/browse/HDFS-11065 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs > Reporter: Xiaobing Zhou > Assignee: Xiaobing Zhou > Labels: fs, test > Attachments: HDFS-11065.000.patch > > > There are some cases of space quota that need to be tested for heterogenous storages. It's quite important to ensure space quota works well in modern clusters typically built out of diversified storage structures. This proposes adding new tests to cover the following scenarios. > # Tests space quota for storage policy = WARM > # Tests if changing replication factor results in copying file as quota doesn't exceed > # Tests if clear quota per heterogenous storage doesnt result in clearing quota for another storage > The following cases have been covered. > # Tests space quota for storage policy = ALL_SSD, covered by TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAllSSD > # Tests if overall space quota exceeds even if particular storage space quota is available, covered by > TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException3 > # Tests spaceQuota for storage policy = Cold, covered by TestQuotaByStorageType#testQuotaByStorageTypeWithTraditionalQuota > # Tests if quota exceeds for DISK storage even if overall space quota is available, covered by > TestQuotaByStorageType#testQuotaByStorageTypeAndTraditionalQuotaException2 > # Tests space quota with append operation, covered by TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateAppend > # Sanity Test : Checks if copy command fails if quota is exceeded, covered by > TestQuotaByStorageType#testQuotaByStorageTypeParent*Child* > # Tests space quota with remove operation, covered by TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateDelete > # Tests space quota with Snapshot operation, covered by TestQuotaByStorageType#testQuotaByStorageTypeWithSnapshot > # Tests space quota with truncate operation, coveved by TestQuotaByStorageType#testQuotaByStorageTypeWithFileCreateTruncate > # Tests space quota remains valid even with Namenode restart, covered by TestQuotaByStorageType#testQuotaByStorageTypePersistenceInEditLog and TestQuotaByStorageType#testQuotaByStorageTypePersistenceInFsImage -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org