avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AVRO-798) add checksums to Snappy codec
Date Tue, 19 Apr 2011 20:53:05 GMT

     [ https://issues.apache.org/jira/browse/AVRO-798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Doug Cutting updated AVRO-798:
------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I committed this.

> add checksums to Snappy codec
> -----------------------------
>
>                 Key: AVRO-798
>                 URL: https://issues.apache.org/jira/browse/AVRO-798
>             Project: Avro
>          Issue Type: Improvement
>          Components: java, spec
>            Reporter: Doug Cutting
>            Assignee: Doug Cutting
>             Fix For: 1.5.1
>
>         Attachments: AVRO-798.patch, AVRO-798.patch
>
>
> A checksum might be included with each compressed block to better detect errors.  While
some filesystems (e.g. HDFS) may checksum data, not all do.  Data files may also accumulate
errors when copied between filesystems.  For back-compatibility, we cannot easily add checksums
to existing data files, but a new codec provides us with the opportunity to do this.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message