arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sanjay Rao <getsanjay...@live.com>
Subject RE: Is LittleEndian system mandatory for using Apache Arrow ?
Date Mon, 01 Aug 2016 17:56:32 GMT
Hi Wes,
Thanks for your reply, so can I say that C++ version of Arrow works on Big Endian system(although
not tested officially) ?
Also would need your help in getting me details on how to run and one sample program using
APIs.
Thanks a lot,Sanjay

> From: wesmckinn@gmail.com
> Date: Mon, 1 Aug 2016 10:32:40 -0700
> Subject: Re: Is LittleEndian system mandatory for using Apache Arrow ?
> To: dev@arrow.apache.org
> CC: emkornfield@gmail.com
> 
> I replied on the other thread (missed this one).
> 
> I believe that since the C++ codebase uses native endianness, we would
> need to add byte-swapping logic in the IPC code path to support big
> endian systems.
> 
> On Mon, Aug 1, 2016 at 9:31 AM, Sanjay Rao <getsanjayrao@live.com> wrote:
> > Hi Micah,
> > Thanks, I am trying to write Java examples with Java libraries of Apache Arrow on
Big Endian system, I already got JARs built, this is part of a research I am doing.
> > I ran "mvn test" on Big Endian system and it failed in TestEndianess, kindly let
me know if at least Java version of Apache Arrow will run on Big Endian system.
> > Thanks,Sanjay
> >
> >> From: emkornfield@gmail.com
> >> Date: Mon, 1 Aug 2016 09:23:51 -0700
> >> Subject: Re: Is LittleEndian system mandatory for using Apache Arrow ?
> >> To: dev@arrow.apache.org
> >>
> >> Hi Sanjay,
> >> There was some discussion on the mailing list a little while ago about this
> >> [1].  We discussed making endianness part of the IPC metadata.  I don't
> >> think we've gotten far enough in the implementation to take action on the
> >> discussion though.
> >>
> >> Right now I think the C++ code at least is endian agnostic, but it hasn't
> >> been tested against a big-endian system as far as I know.  As referenced in
> >> the prior thread (and I don't think its been changed), there is an explicit
> >> check for endianness when constructing vectors in Java
> >>
> >> Cheers,
> >> Micah
> >>
> >>
> >> https://mail-archives.apache.org/mod_mbox/arrow-dev/201604.mbox/%3CCAK7Z5T_0T9hOa=mbJ=V30jc_Em169e=QjpyQnSBLRAkb8dMUuw@mail.gmail.com%3E
> >>
> >> On Mon, Aug 1, 2016 at 8:57 AM, Sanjay Rao <getsanjayrao@live.com> wrote:
> >>
> >> > Hi,
> >> > I read that Integer representation is assumed to LittleEndian in Arrow,
> >> > does this mean we cannot use Arrow in Big Endian Systems like SPARC ?
> >> >
> >> > Thanks,Sanjay
> >
 		 	   		  
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message