hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-7443) Add CRC32C as another DataChecksum implementation
Date Tue, 12 Jul 2011 03:45:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Todd Lipcon updated HADOOP-7443:
--------------------------------

    Attachment: hadoop-7443.txt

Fairly simple patch which adds the new CRC algorithm. The tables are taken from some Intel
sample code under the BSD license, as attributed in the LICENSE file in this diff.

> Add CRC32C as another DataChecksum implementation
> -------------------------------------------------
>
>                 Key: HADOOP-7443
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7443
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io, util
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hadoop-7443.txt
>
>
> CRC32C is another checksum very similar to our existing CRC32, but with a different polynomial.
The chief advantage of this other polynomial is that SSE4.2 includes hardware support for
its calculation. HDFS-2080 is the umbrella JIRA which proposes using this new polynomial to
save substantial amounts of CPU.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message