From user-return-864-archive-asf-public=cust-asf.ponee.io@arrow.apache.org  Wed Dec 30 15:08:04 2020
Return-Path: <user-return-864-archive-asf-public=cust-asf.ponee.io@arrow.apache.org>
X-Original-To: archive-asf-public@cust-asf.ponee.io
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37])
	by mx-eu-01.ponee.io (Postfix) with ESMTPS id D993D18064A
	for <archive-asf-public@cust-asf.ponee.io>; Wed, 30 Dec 2020 16:08:04 +0100 (CET)
Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153])
	by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id 00086665A5
	for <archive-asf-public@cust-asf.ponee.io>; Wed, 30 Dec 2020 15:07:59 +0000 (UTC)
Received: (qmail 88379 invoked by uid 500); 30 Dec 2020 15:07:58 -0000
Mailing-List: contact user-help@arrow.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@arrow.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@arrow.apache.org>
List-Post: <mailto:user@arrow.apache.org>
List-Id: <user.arrow.apache.org>
Reply-To: user@arrow.apache.org
Delivered-To: mailing list user@arrow.apache.org
Received: (qmail 88243 invoked by uid 99); 30 Dec 2020 15:07:58 -0000
Received: from spamproc1-he-fi.apache.org (HELO spamproc1-he-fi.apache.org) (95.217.134.168)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Dec 2020 15:07:58 +0000
Received: from localhost (localhost [127.0.0.1])
	by spamproc1-he-fi.apache.org (ASF Mail Server at spamproc1-he-fi.apache.org) with ESMTP id C3779BFD6E
	for <user@arrow.apache.org>; Wed, 30 Dec 2020 15:07:57 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at spamproc1-he-fi.apache.org
X-Spam-Flag: NO
X-Spam-Score: 0.004
X-Spam-Level:
X-Spam-Status: No, score=0.004 tagged_above=-999 required=6.31
	tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
	DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_MSPIKE_H3=0.001,
	RCVD_IN_MSPIKE_WL=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001]
	autolearn=disabled
Authentication-Results: spamproc1-he-fi.apache.org (amavisd-new);
	dkim=pass (2048-bit key) header.d=upgini.com
Received: from mx1-ec2-va.apache.org ([116.203.227.195])
	by localhost (spamproc1-he-fi.apache.org [95.217.134.168]) (amavisd-new, port 10024)
	with ESMTP id 5DXZ5TzIUtrp for <user@arrow.apache.org>;
	Wed, 30 Dec 2020 15:07:57 +0000 (UTC)
Received-SPF: None (mailfrom) identity=mailfrom; client-ip=209.85.218.52; helo=mail-ej1-f52.google.com; envelope-from=igor@upgini.com; receiver=<UNKNOWN> 
Received: from mail-ej1-f52.google.com (mail-ej1-f52.google.com [209.85.218.52])
	by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 82060BCCEF
	for <user@arrow.apache.org>; Wed, 30 Dec 2020 15:07:56 +0000 (UTC)
Received: by mail-ej1-f52.google.com with SMTP id ga15so22239133ejb.4
        for <user@arrow.apache.org>; Wed, 30 Dec 2020 07:07:56 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=upgini.com; s=google;
        h=from:mime-version:subject:message-id:date:to;
        bh=3eQeVRMw+daGol7dcskfJRLRzHpCKZU5h1gSXZWVAPM=;
        b=J38SZmppoqQALY9shggKyF+MuLeX3aGt988FhSyRnx2DR79/aNp5jETUfHCVT0eByv
         DcMmi1EIFDp2CC+IFzMcUGQK5BTbyCBULZp0RghOaBgVsmCKgpcP0yNRch8Ht6xCxBJ/
         AXgaI1v9o7CpK9Ow063T7Rm7TsWCi13zGpdHwP1WUXV4Bv6XhTNFcBJY1NHMS6DOW6iJ
         QK1IY74bxW+ff6WMfFDM9vjjl6pvwjnmwNYs6du+ngsYDcUMvTrO6LFeWXCKbK9nlG4b
         /Q7Ghe/CIO3iwaGJYuhh5rvHHE2DrnJSNj5yX7zXGO2QAiYDHcq+CXagQdoMGwOmE/t0
         EHyA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:from:mime-version:subject:message-id:date:to;
        bh=3eQeVRMw+daGol7dcskfJRLRzHpCKZU5h1gSXZWVAPM=;
        b=lZ8WJBfj7PcnlddEUxr44Xxsbz6ffPP4cLl4lz6jvCYYTEAShDmHztZ12OH/Xzm3Xs
         iENzcLdk3qPB9XvsjAxha6PRwcGBL/l6hmFgcoluhC629bjkmIJ2gpdivf6A7wnV3s8B
         LIrB596lPVR61uD0wI9ObZJ1jZsYemHXZpFeNveTJl83M2kMMFpV31vT0LnCv2bf2ROp
         t2XhO3rarGCrHCJ7xZ9NIMFmSaTqYPmMwcYFrtFT3ZJtnqSIPlontDHNcp2puAm5rgfe
         dEAAeV6WSxcVT1ix/+ikOHnBirH1BfhNt0ZZpaH3TrQf3Gw6F7ulBsD5fe7psZVbWr5a
         ALgA==
X-Gm-Message-State: AOAM531huI8OmYm854xSek8AYOBPfFCw07mrMRb1dQl/dslCkotqWIvQ
	fKIGDIN48sG6qp9Ywt8Bhlr/KWc1rDKrEa7D
X-Google-Smtp-Source: ABdhPJzs/0ZBVO5xiWxcm4ddvVu6U6xf0oJ/W5KiNIh1/lCnnJV/N4VxTWtx2R7GYMPO+yZAymMn5g==
X-Received: by 2002:a17:906:b0c2:: with SMTP id bk2mr50944545ejb.223.1609340875553;
        Wed, 30 Dec 2020 07:07:55 -0800 (PST)
Received: from [192.168.0.36] ([37.155.35.52])
        by smtp.gmail.com with ESMTPSA id be6sm38407059edb.29.2020.12.30.07.07.54
        for <user@arrow.apache.org>
        (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128);
        Wed, 30 Dec 2020 07:07:55 -0800 (PST)
From: Igor <igor@upgini.com>
Content-Type: multipart/alternative;
	boundary="Apple-Mail=_8E818525-A766-44AD-9F53-715FC12304FD"
Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\))
Subject: Apache Arrow Java
Message-Id: <017A1CA3-D9A2-44A6-91E8-434BB3CBEF80@upgini.com>
Date: Wed, 30 Dec 2020 18:07:53 +0300
To: user@arrow.apache.org
X-Mailer: Apple Mail (2.3608.120.23.2.4)


--Apple-Mail=_8E818525-A766-44AD-9F53-715FC12304FD
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=utf-8

Hello Apache Arrow developers!

We are using apache arrow library in java and python, using arrow-vector =
arrow-memory-unsafe in java and Pyarrow in python.

We try to implement in memory zero copy DataFrame, but we can=E2=80=99t =
find appropriate API in java libraries to get memory address of our =
vectors from python. I have found that API in Pyarrow library, but not =
in java libraries.

What we need:
1) Create vector in java, collect data in memory using arrow as memory =
map API
2) Get memory address or descriptor in java
3) Pass it to the python library Pyarrow
4) Read vector data

We have problem in the point 2

Tell us please, how we can do that. Thank you!


Best regards,
Eshtyganov Igor
https://www.upgini.com <https://www.upgini.com/>=

--Apple-Mail=_8E818525-A766-44AD-9F53-715FC12304FD
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=utf-8

<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">Hello=
 Apache Arrow developers!<br class=3D""><br class=3D"">We are using =
apache arrow library in java and python, using arrow-vector =
arrow-memory-unsafe in java and Pyarrow in python.<br class=3D""><br =
class=3D"">We try to implement in memory zero copy DataFrame, but we =
can=E2=80=99t find appropriate API in java libraries to get memory =
address of our vectors from python. I have found that API in Pyarrow =
library, but not in java libraries.<br class=3D""><br class=3D"">What we =
need:<br class=3D"">1) Create vector in java, collect data in memory =
using arrow as memory map API<br class=3D"">2) Get memory address or =
descriptor in java<br class=3D"">3) Pass it to the python library =
Pyarrow<br class=3D"">4) Read vector data<br class=3D""><br class=3D"">We =
have problem in the point 2<br class=3D""><br class=3D"">Tell us please, =
how we can do that. Thank you!<br class=3D""><br class=3D""><br =
class=3D"">Best regards,<br class=3D"">Eshtyganov Igor<br class=3D""><a =
href=3D"https://www.upgini.com" =
class=3D"">https://www.upgini.com</a></body></html>=

--Apple-Mail=_8E818525-A766-44AD-9F53-715FC12304FD--