arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xander Dunn" <xan...@xander.ai>
Subject Re: [Python] pyarrow.gandiva unavailable on Ubuntu?
Date Tue, 13 Apr 2021 20:16:28 GMT
Typo. The issue remains present. From my Ubuntu machine just now:

```

$ python

>>> import pyarrow as pa

>>> print(pa.__file__)

/ home/xander/anaconda3/envs/plutus_model/lib/python3.7/site-packages/pyarrow/__init__.py
( http://home/xander/anaconda3/envs/plutus_model/lib/python3.7/site-packages/pyarrow/__init__.py
)

>>> import pyarrow.plasma

>>> import pyarrow.gandiva

Traceback (most recent call last):

File "<stdin>", line 1, in <module>

ModuleNotFoundError: No module named 'pyarrow.gandiva'

```

The .py I'm executing on both machines is identical. Works on mac. Not found on Ubuntu.

On Tue, Apr 13, 2021 at 1:01 PM, Micah Kornfield < emkornfield@gmail.com > wrote:

> 
> Hi Xander,
> Was there autocorrect on this e-mail?  the second example shows "gondiva"
> not "gandiva"
> 
> 
> -Micah
> 
> On Tue, Apr 13, 2021 at 12:59 PM Xander Dunn < xander@ xander. ai (
> xander@xander.ai ) > wrote:
> 
> 
>> On my local macOS 11.2.3:
>> 
>> ```
>> 
>> $ python --version
>> 
>> Python 3.7.10
>> 
>> $ pip --version
>> 
>> pip 21.0.1 from
>> /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pip (python
>> 3.7)
>> 
>> $ pip list | grep pyarrow
>> 
>> pyarrow                3.0.0
>> 
>> $ which python
>> 
>> /usr/local/anaconda3/envs/my_model/bin/python
>> 
>> $ python
>> 
>> >>> import pyarrow as pa
>> 
>> >>> print(pa.__file__)
>> 
>> / usr/ local/ anaconda3/ envs/ my_model/ lib/ python3. 7/ site-packages/ pyarrow/
>> __init__. py (
>> http://usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py
>> )
>> 
>> >>> import pyarrow.plasma
>> 
>> >>> import pyarrow.gandiva as ga
>> 
>> >>> print(ga.__file__)
>> 
>> / usr/ local/ anaconda3/ envs/ my_model/ lib/ python3. 7/ site-packages/ pyarrow/
>> gandiva. cpython-37m-darwin. so (
>> http://usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/gandiva.cpython-37m-darwin.so
>> )
>> 
>> ```
>> 
>> 
>> 
>> On my Ubuntu 14.04 instance:
>> 
>> ```
>> 
>> $ python --version
>> 
>> Python 3.7.10
>> 
>> $ pip --version
>> 
>> pip 21.0.1 from
>> /home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pip
>> (python 3.7)
>> 
>> $ pip list | grep pyarrow
>> 
>> pyarrow                3.0.0
>> 
>> $ which python
>> 
>> /home/xander/anaconda3/envs/my_model/bin/python
>> 
>> $ python
>> 
>> >>> import pyarrow as pa
>> 
>> >>> print(pa.__file__)
>> 
>> / home/ xander/ anaconda3/ envs/ my_model/ lib/ python3. 7/ site-packages/
>> pyarrow/ __init__. py (
>> http://home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py
>> )
>> 
>> >>> import pyarrow.plasma
>> 
>> >>> import pyarrow.gondiva
>> 
>> Traceback (most recent call last):
>> 
>> File "<stdin>", line 1, in <module>
>> 
>> ModuleNotFoundError: No module named 'pyarrow.gondiva'
>> 
>> ```
>> 
>> You can see that pyarrow.gondiva is found on mac but not on Ubuntu. Same
>> Python version. Same pyarrow version. I installed both of them with `conda
>> install -c conda-forge pyarrow==3.0.0`.
>> 
>> 
>> 
>> On Mac, I see the expected Cython file and library:
>> 
>> ```
>> 
>> $ l
>> /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ |
>> grep gandiva
>> 
>> -rwxrwxr-x   2 xander  staff   221K Apr  1 12:44 gandiva. cpython-37m-darwin.
>> so ( http://gandiva.cpython-37m-darwin.so/ )
>> 
>> -rw-rw-r--   2 xander  staff    17K Jan 18 14:00 gandiva.pyx
>> 
>> ```
>> 
>> 
>> 
>> On Ubuntu, I see only the Cython file:
>> 
>> ```
>> 
>> $ l ~/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ | grep
>> gandiva
>> 
>> -rw-rw-r-- 1 xander xander  17K Apr 13 12:28 gandiva.pyx
>> 
>> ```
>> 
>> 
>> 
>> Is this expected? Should I be able to import pyarrow.gandiva on Ubuntu?
>> Everything is run on Ubuntu so if I make use of pyarrow.gandiva I'll need
>> to figure out how to call it.
>> 
>> 
>> 
>> It's mentioned here that it was removed from Python wheels but should
>> still be available in the conda install: https:/ / issues. apache. org/ jira/
>> browse/ ARROW-10154 ( https://issues.apache.org/jira/browse/ARROW-10154 ).
>> I'm not finding it in my Ubuntu conda install.
>> 
>> 
>> 
>> Thanks,
>> 
>> Xander
>> 
>> 
>> 
> 
>
Mime
View raw message