arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jonathan mercier <jonathan.merc...@cnrgh.fr>
Subject Re: [python] calling filter method raise this error did not recognize Python value type when inferring an Arrow data type
Date Mon, 08 Mar 2021 17:08:03 GMT
Oh yes it is not the same method as pyarrow.parquet … filters

thanks

best regards

Le vendredi 05 mars 2021 à 20:29 -0800, Micah Kornfield a écrit :
> Hi Jonathan,
> Looking at the docs [1], I think the filter is supposed to be a
> boolean mask.  So unfortunately, I think there are a few steps:
> 
> Use an equality kernel [1] on the column of interest and then pass
> that as an argument to filter.
> 
> -Micah
> 
> 
> [1] https://arrow.apache.org/docs/python/generated/pyarrow.compute.filter.html?highlight=table%20filter#pyarrow-compute-filter
> (Table.filter here points for full usage)
> [2] https://arrow.apache.org/docs/python/generated/pyarrow.compute.equal.html#pyarrow.compute.equal
> 
> On Thu, Mar 4, 2021 at 2:24 AM jonathan mercier
> <jonathan.mercier@cnrgh.fr> wrote:
> > I miss to tell that foo is a type of pyarrow.Table
> > 
> > I load the data like this:
> > 
> > from pyarrow.parquet import read_table
> > foo = read_table(somewhere)
> > 

-- 
                Researcher computational biology
                PhD, Jonathan MERCIER
            
                Bioinformatics (LBI)
                2, rue Gaston
                Crémieux
                91057 Evry Cedex
            
            
                Tel :(+33)1 60 87 83 44
                Email :jonathan.mercier@cnrgh.fr
                
            

Mime
View raw message