Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 13984 invoked from network); 18 Jul 2006 02:31:23 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 18 Jul 2006 02:31:23 -0000 Received: (qmail 25196 invoked by uid 500); 18 Jul 2006 02:31:22 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 25163 invoked by uid 500); 18 Jul 2006 02:31:22 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 25153 invoked by uid 99); 18 Jul 2006 02:31:22 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Jul 2006 19:31:22 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [209.237.227.198] (HELO brutus.apache.org) (209.237.227.198) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Jul 2006 19:31:22 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id C2B70714293 for ; Tue, 18 Jul 2006 02:29:14 +0000 (GMT) Message-ID: <33073948.1153189754795.JavaMail.jira@brutus> Date: Mon, 17 Jul 2006 19:29:14 -0700 (PDT) From: "Konstantin Shvachko (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Updated: (HADOOP-368) DistributedFSCheck should cleanup, seek, and report missing files. In-Reply-To: <26943040.1153189633910.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N [ http://issues.apache.org/jira/browse/HADOOP-368?page=all ] Konstantin Shvachko updated HADOOP-368: --------------------------------------- Attachment: DistributedFSCheck.patch 1) I included calls to cleanup() for DistributedFSCheck and TestDFSIO. DistributedFSCheck calls cleanup before and after execution of the main part. After - in order to restore the files system state. Before - in order to be able to run if the previous run failed. TestDFSIO cleans up only within the unit test. 2) DistributedFSCheck snapshots files at the initial state and then reads them. I added correct processing of files that have been snapshot but disappeared after that. 3) A bug fixed in DistributedFSCheck. The mapper did not seek to the required offset when reading files. > DistributedFSCheck should cleanup, seek, and report missing files. > ------------------------------------------------------------------ > > Key: HADOOP-368 > URL: http://issues.apache.org/jira/browse/HADOOP-368 > Project: Hadoop > Issue Type: Bug > Components: fs > Affects Versions: 0.4.0, 0.3.2 > Reporter: Konstantin Shvachko > Assigned To: Konstantin Shvachko > Priority: Minor > Attachments: DistributedFSCheck.patch > > -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira