Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B410710684 for ; Tue, 24 Feb 2015 02:24:12 +0000 (UTC) Received: (qmail 56813 invoked by uid 500); 24 Feb 2015 02:24:12 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 56751 invoked by uid 500); 24 Feb 2015 02:24:12 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 56739 invoked by uid 99); 24 Feb 2015 02:24:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Feb 2015 02:24:12 +0000 Date: Tue, 24 Feb 2015 02:24:12 +0000 (UTC) From: "Colin Patrick McCabe (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-7648) Verify the datanode directory layout MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334273#comment-14334273 ] Colin Patrick McCabe commented on HDFS-7648: -------------------------------------------- bq. Mmm ... We are not fixing the software bug but fixing the blocks/data. Also, there is a conf. So it is manually but not automatically. If you don't fix the bug, isn't this just going to re-occur? You cannot fix a problem if you don't know what it is. And the software doesn't know why files would be in the wrong position. Similarly, the software doesn't know why VERSION might be missing, or a meta file might not be there, or a volume might not be accessible. > Verify the datanode directory layout > ------------------------------------ > > Key: HDFS-7648 > URL: https://issues.apache.org/jira/browse/HDFS-7648 > Project: Hadoop HDFS > Issue Type: Bug > Components: datanode > Reporter: Tsz Wo Nicholas Sze > Assignee: Rakesh R > Attachments: HDFS-7648-3.patch, HDFS-7648-4.patch, HDFS-7648-5.patch, HDFS-7648.patch, HDFS-7648.patch > > > HDFS-6482 changed datanode layout to use block ID to determine the directory to store the block. We should have some mechanism to verify it. Either DirectoryScanner or block report generation could do the check. -- This message was sent by Atlassian JIRA (v6.3.4#6332)