arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Antoine Pitrou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ARROW-5161) [Python] Cannot convert struct type from Pandas object column
Date Thu, 11 Apr 2019 15:21:00 GMT
Antoine Pitrou created ARROW-5161:
-------------------------------------

             Summary: [Python] Cannot convert struct type from Pandas object column
                 Key: ARROW-5161
                 URL: https://issues.apache.org/jira/browse/ARROW-5161
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.13.0
            Reporter: Antoine Pitrou


As reported on [https://github.com/apache/arrow/issues/4045]. Interestingly, the datatype
is inferred correctly.
{code:python}
>>> df = pd.DataFrame({'col': [{'ints': 5, 'strs': 'foo'}, {'ints': 6, 'strs': 'bar'}]})
                                                                            
>>> df                                                                          
                                                                                    
                          col
0  {'ints': 5, 'strs': 'foo'}
1  {'ints': 6, 'strs': 'bar'}
>>> pa.Table.from_pandas(df)                                                    
                                                                                    
Traceback (most recent call last):
  File "<ipython-input-16-6eac5d0eec08>", line 1, in <module>
    pa.Table.from_pandas(df)
  File "pyarrow/table.pxi", line 1139, in pyarrow.lib.Table.from_pandas
    names, arrays, metadata = dataframe_to_arrays(
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 480, in dataframe_to_arrays
    types)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 209, in construct_metadata
    field_name=sanitized_name)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 151, in get_column_metadata
    logical_type = get_logical_type(arrow_type)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 79, in get_logical_type
    raise NotImplementedError(str(arrow_type))
NotImplementedError: struct<ints: int64, strs: string>
{code}




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message