arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wes McKinney <>
Subject Re: pyarrow.cuda and numba.cuda interoperability
Date Wed, 03 Oct 2018 20:27:28 GMT
hi Pearu,

You can construct a host buffer using pyarrow.foreign_buffer

It would be great to have analogous functionality for CUDA. Last
summer I created this JIRA about "attaching" to a CUDA context created
by another library, may be related:

- Wes
On Wed, Oct 3, 2018 at 12:49 PM Pearu Peterson
<> wrote:
> Hi,
> pa.cuda.CudaBuffer provides address and size of a device memory, so one can
> construct numba.cuda MemoryPointer from a CudaBuffer instance and hence
> there exists a way to pass CudaBuffer instances to numba.cuda jitted
> functions.
> The other way, having a device pointer and size (say, from numba.cuda
> objects) and then construct a CudaBuffer from it, is not currently possible
> within pyarrow.
> Since C++ CudaBuffer has the corresponding constructor already that takes
> the address and size (and context) to produce CudaBuffer instance, would it
> make sense to support this also in Python level? [I can give the
> implementation a try if so]
> Is it possible to construct a pyarrow.Buffer instance from a host pointer
> value and size?
> Best regards,
> Pearu

View raw message