arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Kornfield <emkornfi...@gmail.com>
Subject Re: Using 'zero copy' for interop with python from java
Date Mon, 08 Jun 2020 03:24:19 GMT
Uwe wrote a blog post [1] on how to do this with PY4J a while ago. I think
this ends up being zero copy but not 100% sure.

[1]
https://uwekorn.com/2019/11/17/fast-jdbc-access-in-python-using-pyarrow-jvm.html

On Fri, Jun 5, 2020 at 9:01 PM Chris Zheng <z@caudate.me> wrote:

>
> Hi there,
>
> I’m coming here from clojure, where we are hoping to use more of Arrow for
> https://github.com/clj-python/libpython-clj, a library that gives very
> easy python interop from the JVM.
>
> Here is the link to the initial question:
>
> https://clojurians.zulipchat.com/#narrow/stream/151924-data-science/topic/dplyr-like.20API.20to.20tech.2Eml.2Edataset/near/199914955
>
> The use case would be to load from a database on the Java side and then
> convert it to arrow, allowing it to be consumed by a python ml library
> (with the whole zero copy thing).
>
> Once there is a Java Arrow Object created in the JVM, how would it be
> accessible by the Python Library?
>
> I was hoping to get some input or a simple example on how it might be done
>
> Chris.
>
>
>
>

Mime
View raw message