Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 81527 invoked from network); 28 Jan 2008 17:29:56 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 28 Jan 2008 17:29:56 -0000 Received: (qmail 71343 invoked by uid 500); 28 Jan 2008 17:29:46 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 71320 invoked by uid 500); 28 Jan 2008 17:29:46 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 71311 invoked by uid 500); 28 Jan 2008 17:29:46 -0000 Delivered-To: apmail-lucene-hadoop-dev@lucene.apache.org Received: (qmail 71308 invoked by uid 99); 28 Jan 2008 17:29:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Jan 2008 09:29:46 -0800 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Jan 2008 17:29:27 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 574FE71425E for ; Mon, 28 Jan 2008 09:29:34 -0800 (PST) Message-ID: <16122983.1201541374352.JavaMail.jira@brutus> Date: Mon, 28 Jan 2008 09:29:34 -0800 (PST) From: "Marco Nicosia (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Commented: (HADOOP-2063) Command to pull corrupted files In-Reply-To: <15691887.1192560050865.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12563213#action_12563213 ] Marco Nicosia commented on HADOOP-2063: --------------------------------------- I'm disappointed this didn't go in for Hadoop 0.16, despite having been set as target for 0.16. I understand that this is a pretty big change, but I really want to be sure we get something for Hadoop 0.17. While we wait for this, any old Hadoop DFS' with corrupted files will need to sit, waiting for their owners to have a way to retrieve the files. For that time fsck will always return corrupt. The inability to do anything with these files (except delete them) could be masking us from being able to detect other hadoop issues. > Command to pull corrupted files > ------------------------------- > > Key: HADOOP-2063 > URL: https://issues.apache.org/jira/browse/HADOOP-2063 > Project: Hadoop Core > Issue Type: New Feature > Components: fs > Affects Versions: 0.14.1 > Reporter: Koji Noguchi > Priority: Blocker > Fix For: 0.17.0 > > > Before 0.14, dfs -get didn't perform checksum checking. > Users were able to download the corrupted files to see if they want to delete them. > After 0.14, dfs -get also does the checksumming. > Requesting a command for no-checksum-get command. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.