Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E6036189B5 for ; Fri, 12 Feb 2016 20:49:19 +0000 (UTC) Received: (qmail 85494 invoked by uid 500); 12 Feb 2016 20:49:18 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 85392 invoked by uid 500); 12 Feb 2016 20:49:18 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 85053 invoked by uid 99); 12 Feb 2016 20:49:18 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Feb 2016 20:49:18 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 1F3AE2C1F5D for ; Fri, 12 Feb 2016 20:49:18 +0000 (UTC) Date: Fri, 12 Feb 2016 20:49:18 +0000 (UTC) From: "Kihwal Lee (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HDFS-9802) Selectively save blocks to trash dir during rolling upgrades MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Kihwal Lee created HDFS-9802: -------------------------------- Summary: Selectively save blocks to trash dir during rolling upgrades Key: HDFS-9802 URL: https://issues.apache.org/jira/browse/HDFS-9802 Project: Hadoop HDFS Issue Type: Bug Reporter: Kihwal Lee Currently datanodes save any invalidated blocks to the trash directory during a rolling upgrade. Compared to the "previous" directory for full upgrade, the trash can grow quickly. This is especially true when blocks are created and then quickly deleted. Since trash is mainly meant to be defense against faulty new namenode and used for rolling back, saving new blocks in trash does not add much value. If anything, datanodes run out of space quicker. -- This message was sent by Atlassian JIRA (v6.3.4#6332)