avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AVRO-798) add checksums to Snappy codec
Date Wed, 06 Apr 2011 22:10:06 GMT
add checksums to Snappy codec
-----------------------------

                 Key: AVRO-798
                 URL: https://issues.apache.org/jira/browse/AVRO-798
             Project: Avro
          Issue Type: Improvement
          Components: java, spec
            Reporter: Doug Cutting
            Assignee: Doug Cutting
             Fix For: 1.5.1


A checksum might be included with each compressed block to better detect errors.  While some
filesystems (e.g. HDFS) may checksum data, not all do.  Data files may also accumulate errors
when copied between filesystems.  For back-compatibility, we cannot easily add checksums to
existing data files, but a new codec provides us with the opportunity to do this.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message