arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wes McKinney (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ARROW-364) [Python] Multithreaded conversion between Arrow record batches as NumPy arrays (for pandas)
Date Thu, 03 Nov 2016 17:37:58 GMT
Wes McKinney created ARROW-364:
----------------------------------

             Summary: [Python] Multithreaded conversion between Arrow record batches as NumPy
arrays (for pandas)
                 Key: ARROW-364
                 URL: https://issues.apache.org/jira/browse/ARROW-364
             Project: Apache Arrow
          Issue Type: New Feature
          Components: Python
            Reporter: Wes McKinney


This only impacts columns that are not zero-copyable. The GIL only needs to be held while
invoking C API functions like {{PyArray_SimpleNew}} or {{PyString_FromStringAndSize}}. If
there are many string columns, we may be concerned over GIL contention



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message