arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Kornfield <emkornfi...@gmail.com>
Subject Re: [Python] pyarrow.gandiva unavailable on Ubuntu?
Date Tue, 13 Apr 2021 20:01:59 GMT
Hi Xander,
Was there autocorrect on this e-mail?  the second example shows "gondiva"
not "gandiva"

-Micah

On Tue, Apr 13, 2021 at 12:59 PM Xander Dunn <xander@xander.ai> wrote:

> On my local macOS 11.2.3:
> ```
> $ python --version
> Python 3.7.10
> $ pip --version
> pip 21.0.1 from
> /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pip (python
> 3.7)
> $ pip list | grep pyarrow
> pyarrow                3.0.0
> $ which python
> /usr/local/anaconda3/envs/my_model/bin/python
> $ python
> >>> import pyarrow as pa
> >>> print(pa.__file__)
> /
> usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py
> >>> import pyarrow.plasma
> >>> import pyarrow.gandiva as ga
> >>> print(ga.__file__)
> /
> usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/gandiva.cpython-37m-darwin.so
> ```
>
> On my Ubuntu 14.04 instance:
> ```
> $ python --version
> Python 3.7.10
> $ pip --version
> pip 21.0.1 from
> /home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pip
> (python 3.7)
> $ pip list | grep pyarrow
> pyarrow                3.0.0
> $ which python
> /home/xander/anaconda3/envs/my_model/bin/python
> $ python
> >>> import pyarrow as pa
> >>> print(pa.__file__)
> /
> home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py
> >>> import pyarrow.plasma
> >>> import pyarrow.gondiva
> Traceback (most recent call last):
>   File "<stdin>", line 1, in <module>
> ModuleNotFoundError: No module named 'pyarrow.gondiva'
> ```
> You can see that pyarrow.gondiva is found on mac but not on Ubuntu. Same
> Python version. Same pyarrow version. I installed both of them with `conda
> install -c conda-forge pyarrow==3.0.0`.
>
> On Mac, I see the expected Cython file and library:
> ```
> $ l
> /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ |
> grep gandiva
> -rwxrwxr-x   2 xander  staff   221K Apr  1 12:44
> gandiva.cpython-37m-darwin.so
> -rw-rw-r--   2 xander  staff    17K Jan 18 14:00 gandiva.pyx
> ```
>
> On Ubuntu, I see only the Cython file:
> ```
> $ l ~/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ | grep
> gandiva
> -rw-rw-r-- 1 xander xander  17K Apr 13 12:28 gandiva.pyx
> ```
>
> Is this expected? Should I be able to import pyarrow.gandiva on Ubuntu?
> Everything is run on Ubuntu so if I make use of pyarrow.gandiva I'll need
> to figure out how to call it.
>
> It's mentioned here that it was removed from Python wheels but should
> still be available in the conda install:
> https://issues.apache.org/jira/browse/ARROW-10154. I'm not finding it in
> my Ubuntu conda install.
>
> Thanks,
> Xander
>
>

Mime
View raw message