hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7446) Implement CRC32C native code using SSE4.2 instructions
Date Fri, 12 Aug 2011 19:48:27 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084329#comment-13084329
] 

Todd Lipcon commented on HADOOP-7446:
-------------------------------------

actually scratch that... I think I hadn't done a full clean build or something - once I tried
to debug it, I couldn't reproduce. But if someone else can verify that "mvn -Pnative test
-Dtest=TestDataChecksum" works when they set JAVA_HOME to a 32-bit JDK, that would be great.
I'll upload a fixed patch momentarily

> Implement CRC32C native code using SSE4.2 instructions
> ------------------------------------------------------
>
>                 Key: HADOOP-7446
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7446
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: native
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 0.23.0
>
>         Attachments: hadoop-7446.txt, hadoop-7446.txt
>
>
> Once HADOOP-7445 is implemented, we can get further performance improvements by implementing
CRC32C using the hardware support available in SSE4.2. This support should be dynamically
enabled based on CPU feature flags, and of course should be ifdeffed properly so that it doesn't
break the build on architectures/platforms where it's not available.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message