hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward Nevill (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-10752) Add support for hardware crc on ARM aarch64 architecture
Date Thu, 26 Jun 2014 08:55:25 GMT
Edward Nevill created HADOOP-10752:

             Summary: Add support for hardware crc on ARM aarch64 architecture
                 Key: HADOOP-10752
                 URL: https://issues.apache.org/jira/browse/HADOOP-10752
             Project: Hadoop Common
          Issue Type: Improvement
          Components: native, performance
    Affects Versions: trunk-win
         Environment: ARM aarch64 Juno development platform
            Reporter: Edward Nevill
            Priority: Minor
             Fix For: trunk-win

This patch adds support for hardware crc for ARM's new 64 bit architecture.

The patch is completely conditionalized on __arch64__

For the moment I have only done the non pipelined version as the hw I have only has 1 crc
execute unit.

Some initial benchmarks on terasort give

sw crc: 107 sec
hw crc: 103 sec

The performance improvement is quite small, but this is limited by the fact that I am using
early stage hw which is not performant.

I have also built it on x86 and I think the change is fairly safe for other architectures
because post conditionalization the src is identical on other architectures.

This is the first patch I have submitted for Hadoop so I would welcome any feedback and help.

This message was sent by Atlassian JIRA

View raw message