hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-7446) Implement CRC32C native code using SSE4.2 instructions
Date Mon, 22 Aug 2011 22:40:29 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Todd Lipcon updated HADOOP-7446:
--------------------------------

    Attachment: crc-pipeline-fix.txt

Found the bug in your code -- you weren't updating the data pointer when there was a remaining
group of blocks past processing all the triplets. Also fixed a typo in spelling the function
name. With this patch I can run the hbase test without checksum errors.

> Implement CRC32C native code using SSE4.2 instructions
> ------------------------------------------------------
>
>                 Key: HADOOP-7446
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7446
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: native
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 0.23.0
>
>         Attachments: crc-pipeline-fix.txt, hadoop-7446.txt, hadoop-7446.txt, hadoop-7446.txt,
pipelined_on_todds_patch.txt, pipelined_with_todds_patch.txt
>
>
> Once HADOOP-7445 is implemented, we can get further performance improvements by implementing
CRC32C using the hardware support available in SSE4.2. This support should be dynamically
enabled based on CPU feature flags, and of course should be ifdeffed properly so that it doesn't
break the build on architectures/platforms where it's not available.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message