Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9F2EA8471 for ; Mon, 22 Aug 2011 22:40:53 +0000 (UTC) Received: (qmail 1670 invoked by uid 500); 22 Aug 2011 22:40:53 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 1624 invoked by uid 500); 22 Aug 2011 22:40:52 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 1608 invoked by uid 99); 22 Aug 2011 22:40:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Aug 2011 22:40:52 +0000 X-ASF-Spam-Status: No, hits=-2000.9 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Aug 2011 22:40:50 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 0D0D5CA647 for ; Mon, 22 Aug 2011 22:40:29 +0000 (UTC) Date: Mon, 22 Aug 2011 22:40:29 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: common-issues@hadoop.apache.org Message-ID: <1396065023.3248.1314052829050.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1466195919.2703.1309927696639.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HADOOP-7446) Implement CRC32C native code using SSE4.2 instructions MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HADOOP-7446: -------------------------------- Attachment: crc-pipeline-fix.txt Found the bug in your code -- you weren't updating the data pointer when there was a remaining group of blocks past processing all the triplets. Also fixed a typo in spelling the function name. With this patch I can run the hbase test without checksum errors. > Implement CRC32C native code using SSE4.2 instructions > ------------------------------------------------------ > > Key: HADOOP-7446 > URL: https://issues.apache.org/jira/browse/HADOOP-7446 > Project: Hadoop Common > Issue Type: Improvement > Components: native > Affects Versions: 0.23.0 > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Fix For: 0.23.0 > > Attachments: crc-pipeline-fix.txt, hadoop-7446.txt, hadoop-7446.txt, hadoop-7446.txt, pipelined_on_todds_patch.txt, pipelined_with_todds_patch.txt > > > Once HADOOP-7445 is implemented, we can get further performance improvements by implementing CRC32C using the hardware support available in SSE4.2. This support should be dynamically enabled based on CPU feature flags, and of course should be ifdeffed properly so that it doesn't break the build on architectures/platforms where it's not available. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira