Return-Path: Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: (qmail 12642 invoked from network); 14 Feb 2010 04:44:51 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 14 Feb 2010 04:44:51 -0000 Received: (qmail 81011 invoked by uid 500); 14 Feb 2010 04:44:51 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 80870 invoked by uid 500); 14 Feb 2010 04:44:51 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 80848 invoked by uid 99); 14 Feb 2010 04:44:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Feb 2010 04:44:51 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Feb 2010 04:44:49 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 22E4A29A0018 for ; Sat, 13 Feb 2010 20:44:28 -0800 (PST) Message-ID: <1921964266.259881266122668141.JavaMail.jira@brutus.apache.org> Date: Sun, 14 Feb 2010 04:44:28 +0000 (UTC) From: "Rodrigo Schmidt (JIRA)" To: mapreduce-issues@hadoop.apache.org Subject: [jira] Updated: (MAPREDUCE-1491) Use HAR filesystem to merge parity files In-Reply-To: <1417798041.259731266122548052.JavaMail.jira@brutus.apache.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Schmidt updated MAPREDUCE-1491: --------------------------------------- Status: Patch Available (was: Open) > Use HAR filesystem to merge parity files > ----------------------------------------- > > Key: MAPREDUCE-1491 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1491 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Reporter: Rodrigo Schmidt > Assignee: Rodrigo Schmidt > Attachments: MAPREDUCE-1491.0.patch > > > The HDFS raid implementation (HDFS-503) creates a parity file for every file that is RAIDed. This puts additional burden on the memory requirements of the namenode. It will be nice if the parity files are combined together using the HadoopArchive (har) format. > This was (HDFS-684) before, but raid migrated to MAPREDUCE. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.