arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fan Liya <liya.fa...@gmail.com>
Subject Re: Arrow for low latency IPC
Date Fri, 01 Nov 2019 08:32:02 GMT
Hi Samrat,

Arrow has flexible support for IPC through grpc.

The cpp benchmark can be found in:
https://github.com/apache/arrow/blob/master/cpp/src/arrow/flight/flight_benchmark.cc

The java benchmark can be found in:
https://github.com/apache/arrow/blob/master/java/flight/src/test/java/org/apache/arrow/flight/perf/TestPerf.java

About the latency problem, I am not clear about your scenario. Can you
reduce the latency by making the batch small enough?

Best,
Liya Fan

On Fri, Nov 1, 2019 at 10:58 AM Samrat Batth <samratbatth@gmail.com> wrote:

> Hi,
>
> I am new to Apache Arrow and want to consider it for low latency IPC
> stream. I want to see if I can use Arrow for low latency IPC via processes
> written in multiple languages.
>
> As far as what I can understand about current version of Arrow, the
> messages are passed in a batch via IPC, ie the RX will get the msgs in
> batch and not as soon as they are sent by the TX.
>
> Any pointers to examples / code for this? Or any benchmarks on IPC?
>
> Thanks,
> Sam

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message