hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rodrigo Schmidt (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1491) Use HAR filesystem to merge parity files
Date Sun, 14 Feb 2010 04:42:28 GMT
Use HAR filesystem to merge parity files 

                 Key: MAPREDUCE-1491
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1491
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Rodrigo Schmidt
            Assignee: Rodrigo Schmidt

The HDFS raid implementation (HDFS-503) creates a parity file for every file that is RAIDed.
This puts additional burden on the memory requirements of the namenode. It will be  nice if
the parity files are combined together using the HadoopArchive (har) format.

This was (HDFS-684) before, but raid migrated to MAPREDUCE.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message