hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7443) Add CRC32C as another DataChecksum implementation
Date Wed, 13 Jul 2011 03:22:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13064319#comment-13064319
] 

Tsz Wo (Nicholas), SZE commented on HADOOP-7443:
------------------------------------------------

+1 patch looks good.

Please test it with the Intel sample code or other implementations.

> Add CRC32C as another DataChecksum implementation
> -------------------------------------------------
>
>                 Key: HADOOP-7443
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7443
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io, util
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hadoop-7443.txt, hadoop-7443.txt
>
>
> CRC32C is another checksum very similar to our existing CRC32, but with a different polynomial.
The chief advantage of this other polynomial is that SSE4.2 includes hardware support for
its calculation. HDFS-2080 is the umbrella JIRA which proposes using this new polynomial to
save substantial amounts of CPU.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message