hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Burlison (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11505) hadoop-mapreduce-client-nativetask uses bswap where be32toh is needed, doesn't work on non-x86
Date Wed, 25 Nov 2015 17:21:11 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027194#comment-15027194
] 

Alan Burlison commented on HADOOP-11505:
----------------------------------------

It's looking in /usr/include for one of endian.h, sys/endian.h or sys/byteorder.h, and then
for either be16toh or BSWAP_64. If the include file is in a different place on OSX or the
macros are called something different then no, it won't work. I don't have access to OSX to
check, but as long as there's a way to define the HADOOP_XXX macros in hadoop-common-project/hadoop-common/src/CMakeLists.txt
then the rest should just work - everything else in the patch uses the macros that are probed/configured
by CMake.

> hadoop-mapreduce-client-nativetask uses bswap where be32toh is needed, doesn't work on
non-x86
> ----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-11505
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11505
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>            Reporter: Colin Patrick McCabe
>            Assignee: Colin Patrick McCabe
>         Attachments: HADOOP-11505.001.patch, HADOOP-11505.003.patch, HADOOP-11505.004.patch,
HADOOP-11505.005.patch
>
>
> hadoop-mapreduce-client-nativetask fails to use x86 optimizations in some cases.  Also,
on some alternate, non-x86, non-ARM architectures the generated code is incorrect.  Thanks
to Steve Loughran and Edward Nevill for finding this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message