hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7443) Add CRC32C as another DataChecksum implementation
Date Tue, 12 Jul 2011 13:43:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13063896#comment-13063896
] 

Todd Lipcon commented on HADOOP-7443:
-------------------------------------

Thanks Nicholas. I tried to use your table-generating code, but somehow my results were ending
up bit-reflected or something :)

> Add CRC32C as another DataChecksum implementation
> -------------------------------------------------
>
>                 Key: HADOOP-7443
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7443
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io, util
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hadoop-7443.txt
>
>
> CRC32C is another checksum very similar to our existing CRC32, but with a different polynomial.
The chief advantage of this other polynomial is that SSE4.2 includes hardware support for
its calculation. HDFS-2080 is the umbrella JIRA which proposes using this new polynomial to
save substantial amounts of CPU.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message