Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-dev@hadoop.apache.org
Date: Mon, 24 Nov 2014 04:36:12 +0000 (UTC)
From: "Colin Patrick McCabe (JIRA)" <jira@apache.org>
To: hdfs-dev@hadoop.apache.org
Message-ID: <JIRA.12757328.1416803753000.4052.1416803772307@Atlassian.JIRA>
In-Reply-To: <JIRA.12757328.1416803753000@Atlassian.JIRA>
References: <JIRA.12757328.1416803753000@Atlassian.JIRA>
 <JIRA.12757328.1416803753163@arcas>
Subject: [jira] [Created] (HDFS-7430) Refactor the BlockScanner to use O(1)
 memory and use multiple threads
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Colin Patrick McCabe created HDFS-7430:
------------------------------------------

             Summary: Refactor the BlockScanner to use O(1) memory and use multiple threads
                 Key: HDFS-7430
                 URL: https://issues.apache.org/jira/browse/HDFS-7430
             Project: Hadoop HDFS
          Issue Type: Improvement
    Affects Versions: 2.7.0
            Reporter: Colin Patrick McCabe


We should update the BlockScanner to use a constant amount of memory by keeping track of what block was scanned last, rather than by tracking the scan status of all blocks in memory.  Also, instead of having just one thread, we should have a verification thread per hard disk (or other volume), scanning at a configurable rate of bytes per second.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)