hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-746) CRC computation and reading should move into a nested FileSystem
Date Wed, 22 Nov 2006 23:54:02 GMT
CRC computation and reading should move into a nested FileSystem

                 Key: HADOOP-746
                 URL: http://issues.apache.org/jira/browse/HADOOP-746
             Project: Hadoop
          Issue Type: Improvement
          Components: fs
    Affects Versions: 0.8.0
            Reporter: Owen O'Malley
         Assigned To: Owen O'Malley

Currently FileSystem provides both an interface and a mechanism for computing and checking
crc files. I propose splitting the crc code into a nestable FileSystem that like the PhasedFileSystem
has a backing FileSystem. Once the Paths are converted to URI, this is fairly natural to express.
To use crc files, your uris will look like:

crc://hdfs:%2f%2fhost1:8020/ which is a crc FileSystem with an underlying file system of hdfs://host1:8020

This will allow users to use crc files where they make sense for their application/cluster
and get rid of the "raw" methods.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message