From user-return-496-archive-asf-public=cust-asf.ponee.io@arrow.apache.org  Mon Jun  8 07:55:16 2020
Return-Path: <user-return-496-archive-asf-public=cust-asf.ponee.io@arrow.apache.org>
X-Original-To: archive-asf-public@cust-asf.ponee.io
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [207.244.88.153])
	by mx-eu-01.ponee.io (Postfix) with SMTP id 478E5180647
	for <archive-asf-public@cust-asf.ponee.io>; Mon,  8 Jun 2020 09:55:16 +0200 (CEST)
Received: (qmail 11758 invoked by uid 500); 8 Jun 2020 07:55:15 -0000
Mailing-List: contact user-help@arrow.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@arrow.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@arrow.apache.org>
List-Post: <mailto:user@arrow.apache.org>
List-Id: <user.arrow.apache.org>
Reply-To: user@arrow.apache.org
Delivered-To: mailing list user@arrow.apache.org
Received: (qmail 11744 invoked by uid 99); 8 Jun 2020 07:55:15 -0000
Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Jun 2020 07:55:15 +0000
Received: from localhost (localhost [127.0.0.1])
	by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 6A5B01A31EC
	for <user@arrow.apache.org>; Mon,  8 Jun 2020 07:55:14 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org
X-Spam-Flag: NO
X-Spam-Score: 1.964
X-Spam-Level: *
X-Spam-Status: No, score=1.964 tagged_above=-999 required=6.31
	tests=[HTML_MESSAGE=0.2, KAM_DMARC_STATUS=0.01, KAM_INFOUSMEBIZ=0.75,
	KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_NONE=-0.0001,
	RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001,
	SPF_NONE=0.001] autolearn=disabled
Received: from mx1-he-de.apache.org ([10.40.0.8])
	by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024)
	with ESMTP id gBHYZnJTEj4Y for <user@arrow.apache.org>;
	Mon,  8 Jun 2020 07:55:12 +0000 (UTC)
Received-SPF: None (mailfrom) identity=mailfrom; client-ip=216.40.44.111; helo=smtprelay.hostedemail.com; envelope-from=z@caudate.me; receiver=<UNKNOWN> 
Received: from smtprelay.hostedemail.com (smtprelay0111.hostedemail.com [216.40.44.111])
	by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 497A77F567
	for <user@arrow.apache.org>; Mon,  8 Jun 2020 07:55:11 +0000 (UTC)
Received: from filter.hostedemail.com (clb03-v110.bra.tucows.net [216.40.38.60])
	by smtprelay05.hostedemail.com (Postfix) with ESMTP id D9C821809BCED
	for <user@arrow.apache.org>; Mon,  8 Jun 2020 07:55:04 +0000 (UTC)
X-Session-Marker: 7A40636175646174652E6D65
X-Spam-Summary: 50,0,0,,d41d8cd98f00b204,z@caudate.me,,RULES_HIT:41:72:152:355:379:541:599:800:960:962:967:973:983:988:989:1189:1208:1212:1221:1260:1261:1313:1314:1345:1359:1381:1431:1436:1437:1516:1517:1518:1534:1541:1567:1575:1588:1589:1592:1594:1711:1714:1730:1776:1792:2068:2069:2525:2553:2565:2682:2685:2859:2901:2933:2937:2939:2942:2945:2947:2951:2954:3022:3138:3139:3140:3141:3142:3867:3870:3871:3874:3934:3936:3938:3941:3944:3947:3950:3953:3956:3959:4250:5007:6117:6119:6657:7514:7652:9025:9177:10004:10214:10400:10848:11232:11527:11658:11914:12043:12297:12740:12895:13139:14181:14659:14721:21080:21433:21451:21627:21788:21939:30054:30079:30090,0,RBL:none,CacheIP:none,Bayesian:0.5,0.5,0.5,Netcheck:none,DomainCache:0,MSF:not bulk,SPF:,MSBL:0,DNSBL:none,Custom_rules:0:0:0,LFtime:2,LUA_SUMMARY:none
X-HE-Tag: glove67_310a24e26db8
X-Filterd-Recvd-Size: 2946
Received: from [127.0.0.1] (unknown [183.224.84.233])
	(Authenticated sender: z@caudate.me)
	by omf11.hostedemail.com (Postfix) with ESMTPA
	for <user@arrow.apache.org>; Mon,  8 Jun 2020 07:55:03 +0000 (UTC)
From: Chris Zheng <z@caudate.me>
Content-Type: multipart/alternative;
	boundary="Apple-Mail=_8F213C13-0DE9-4148-91BF-485C84143D8D"
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\))
Subject: Re: Using 'zero copy' for interop with python from java
Date: Mon, 8 Jun 2020 15:54:56 +0800
References: <8D522D4E-FF0C-48CC-9921-E2AD0C32C29F@caudate.me>
 <6B541BF2-2298-4A7D-894E-D64800B94E44@caudate.me>
 <CAK7Z5T8LZq-mNhK2dbKsDwRF2fT+hyStFCJ-C70M5mJHOh7jtA@mail.gmail.com>
To: user@arrow.apache.org
In-Reply-To: <CAK7Z5T8LZq-mNhK2dbKsDwRF2fT+hyStFCJ-C70M5mJHOh7jtA@mail.gmail.com>
Message-Id: <1413A2FC-8323-44AD-901F-C7306D53ED54@caudate.me>
X-Mailer: Apple Mail (2.3608.80.23.2.2)


--Apple-Mail=_8F213C13-0DE9-4148-91BF-485C84143D8D
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=utf-8

That blog post is really good. However, I=E2=80=99d like to do this in a =
running JVM as opposed to a python program.


> On 8 Jun 2020, at 11:24 am, Micah Kornfield <emkornfield@gmail.com> =
wrote:
>=20
> Uwe wrote a blog post [1] on how to do this with PY4J a while ago. I =
think this ends up being zero copy but not 100% sure. =20
>=20
> [1] =
https://uwekorn.com/2019/11/17/fast-jdbc-access-in-python-using-pyarrow-jv=
m.html =
<https://uwekorn.com/2019/11/17/fast-jdbc-access-in-python-using-pyarrow-j=
vm.html>

--Apple-Mail=_8F213C13-0DE9-4148-91BF-485C84143D8D
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=utf-8

<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">That =
blog post is really good. However, I=E2=80=99d like to do this in a =
running JVM as opposed to a python program.<div class=3D""><br =
class=3D""><div><br class=3D""><blockquote type=3D"cite" class=3D""><div =
class=3D"">On 8 Jun 2020, at 11:24 am, Micah Kornfield &lt;<a =
href=3D"mailto:emkornfield@gmail.com" =
class=3D"">emkornfield@gmail.com</a>&gt; wrote:</div><br =
class=3D"Apple-interchange-newline"><div class=3D""><div dir=3D"ltr" =
class=3D"">Uwe wrote a blog post [1] on how to do this with PY4J a while =
ago. I think this ends up being zero copy but not 100% =
sure.&nbsp;&nbsp;<div class=3D""><br class=3D""></div><div =
class=3D"">[1]&nbsp;<a =
href=3D"https://uwekorn.com/2019/11/17/fast-jdbc-access-in-python-using-py=
arrow-jvm.html" =
class=3D"">https://uwekorn.com/2019/11/17/fast-jdbc-access-in-python-using=
-pyarrow-jvm.html</a></div></div></div></blockquote></div><br =
class=3D""></div></body></html>=

--Apple-Mail=_8F213C13-0DE9-4148-91BF-485C84143D8D--