arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xander Dunn" <xan...@xander.ai>
Subject [Python] pyarrow.gandiva unavailable on Ubuntu?
Date Tue, 13 Apr 2021 19:59:30 GMT
On my local macOS 11.2.3:

```

$ python --version

Python 3.7.10

$ pip --version

pip 21.0.1 from /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pip (python
3.7)

$ pip list | grep pyarrow

pyarrow                3.0.0

$ which python

/usr/local/anaconda3/envs/my_model/bin/python

$ python

>>> import pyarrow as pa

>>> print(pa.__file__)

/ usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py ( http://usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py
)

>>> import pyarrow.plasma

>>> import pyarrow.gandiva as ga

>>> print(ga.__file__)

/ usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/gandiva.cpython-37m-darwin.so
( http://usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/gandiva.cpython-37m-darwin.so
)

```

On my Ubuntu 14.04 instance:

```

$ python --version

Python 3.7.10

$ pip --version

pip 21.0.1 from /home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pip (python
3.7)

$ pip list | grep pyarrow

pyarrow                3.0.0

$ which python

/home/xander/anaconda3/envs/my_model/bin/python

$ python

>>> import pyarrow as pa

>>> print(pa.__file__)

/ home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py ( http://home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py
)

>>> import pyarrow.plasma

>>> import pyarrow.gondiva

Traceback (most recent call last):

File "<stdin>", line 1, in <module>

ModuleNotFoundError: No module named 'pyarrow.gondiva'

```

You can see that pyarrow.gondiva is found on mac but not on Ubuntu. Same Python version. Same
pyarrow version. I installed both of them with `conda install -c conda-forge pyarrow==3.0.0`.

On Mac, I see the expected Cython file and library:

```

$ l /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ | grep gandiva

-rwxrwxr-x   2 xander  staff   221K Apr  1 12:44 gandiva.cpython-37m-darwin.so ( http://gandiva.cpython-37m-darwin.so/
)

-rw-rw-r--   2 xander  staff    17K Jan 18 14:00 gandiva.pyx

```

On Ubuntu, I see only the Cython file:

```

$ l ~/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ | grep gandiva

-rw-rw-r-- 1 xander xander  17K Apr 13 12:28 gandiva.pyx

```

Is this expected? Should I be able to import pyarrow.gandiva on Ubuntu? Everything is run
on Ubuntu so if I make use of pyarrow.gandiva I'll need to figure out how to call it.

It's mentioned here that it was removed from Python wheels but should still be available in
the conda install: https://issues.apache.org/jira/browse/ARROW-10154. I'm not finding it in
my Ubuntu conda install.

Thanks,

Xander
Mime
View raw message