arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sambit Tripathy (RBEI/EDS1)" <Sambit.Tripa...@in.bosch.com>
Subject RE: vs Tachyon
Date Thu, 18 Feb 2016 23:52:31 GMT
Sounds exciting.

-Sambit.


-----Original Message-----
From: Jacques Nadeau [mailto:jacques@apache.org] 
Sent: Thursday, February 18, 2016 2:55 PM
To: dev@arrow.apache.org
Subject: Re: vs Tachyon

A simple (albeit somewhat limited) analogy would be a comparison to Parquet
and HDFS.

Parquet is a way to store data in a columnar representation on disk. HDFS
is a distributed way to read and write streams of data on physical media.

Arrow is (amongst other things) a way to structure data in memory for high
speed processing and deals with records, fields and datatypes. Tachyon is
distributed way to read and write streams of data in-memory.

There is a great opportunity to integrate Tachyon and Arrow as they are
very complimentary. Being able to share Arrow representations through a
shared in-memory storage system would be helpful to many applications.



On Thu, Feb 18, 2016 at 11:45 AM, Sambit Tripathy (RBEI/EDS1) <
Sambit.Tripathy@in.bosch.com> wrote:

>
> Hi,
>
> I thank the community for this initiative.
>
> Just out of curiosity, is this similar to http://tachyon-project.org/
> (Tachyon)?
>
>
>
> Best regards
>
> Sambit Tripathy
>
>
>
Mime
View raw message